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GLOSSARY 


ALIAS 


ALPHA 


AXIAL  POINTS  OR  STAR  POINTS 


CENTER  POINT 


CENTRAL  COMPOSITE  DESIGN 


CODED  LEVEL 


Effect  that  cannot  be  distinguished 
from  another  effect. 

In  a  central  composite  design  the 
non-zero  coded  level  value  of  a 
factor  at  an  axial  point. 

In  a  central  composite  design  for 
each  factor  there  are  two  corre¬ 
sponding  axial  points:  The  given 
factor  has  coded  level  -ALPHA  at  one 
point  and  +ALPHA  at  the  other, 
whereas  all  other  factors  have  coded 
level  zero  at  these  points. 

The  point  in  a  central  composite 
design  where  all  N  factors  have  coded 
level  zero. 

A  combination  of  a  full  or  fractional 
two- level  factorial  design  and  some 
additional  experimental  points 
selected  in  a  particular  manner  to 
allow  the  determination  of  the 
quadratic  one  factor  effects.  It  is 
specifically  intended  to  allow 
determination  of  the  constraints  used 
In  defining  a  quadratic  approximation 
of  the  response  surface. 

The  level  of  a  factor  translated  from 
the  true  quantitative  level  used  for 
simplifying  calculations. 


CONFOUNDING  An  experimental  arrangement  in  which 

certain  effects  cannot  be  distin¬ 
guished  from  others. 

The  square  root  of  the  proportion 
of  total  variation  accounted  for  by 
linear  regression. 

CORRELATION  INDEX  R  The  square  root  of  the  proportion  of 

total  variation  accounted  for  by  the 
regression  equation  of  the  degree 
being  fitted  to  the  data. 

DEFINING  CONTRAST  Selection  of  effects  to  be  con¬ 

founded. 

DEGREES  OF  FREEDOM  One  less  than  the  number  of  values 

required  to  compute  the  sum  of 
squares. 

EFFECT  Change  in  response  caused  by  a  change 

In  the  level  of  a  factor. 

EXPERIMENT  MODEL  Hypothesized  equation  to  describe  the 

response  as  a  function  of  the  treatment. 

EXPERIMENTAL  TRIAL  One  unit  of  a  complete  experiment, 

conducted  with  factors  at  levels 
defined  by  a  single  observation  vector. 

FACTORIAL  EXPERIMENT  An  experiment  in  which  all  levels  of 

each  factor  In  the  experiment  are 
combined  with  all  levels  of  every 
other  factor. 


CORRELATION  COEFFICIENT 
(Pearson  R) 


FRACTIONAL  FACTORIAL  An  experimental  design  In  which  only 

a  fraction  of  a  complete  factorial  Is 
run. 

INTERACTION  An  Interaction  between  two  factors 

means  that  a  change  In  response 
between  levels  of  one  factor  Is  not 
the  same  for  all  levels  of  the  other 
factor. 

Sum  of  squares  of  the  error  divided 
by  the  number  of  degrees  of  freedom 
for  the  error  term. 

A  full  or  fractional  factorial  design 
where  some  factors  of  the  design  have 
a  different  number  of  levels  than 
other  factors  of  the  design. 

Planned  level  of  each  factor  for  a 
single  experimental  trial. 

The  true  quantitative  level  of  a 
factor  that  corresponds  to  a  coded 
level. 

REGRESSION  Linear  -  Response  =  A*X1+B*X2+C*X3+... 

Z*XN;  Quadratic  -  Response 
«A*X1+B*X2+. . .+  C*X1X2+D*X1*X3+. . . 

+E  *X 1**2+F *X  2**2+ . . . 


MEAN  SQUARE  ERROR 


MIXED  LEVEL  DESIGN 


OBSERVATION  VECTOR 

REAL  WORLD  LEVEL 


REPLICATE 


Repetition  of  observation  vectors 
applied  to  multiple  experimental 
trials. 


RESPONSE  FUNCTION 


The  function  F  or  V  =  F(X1,X2,...XN) 
where  the  levels  of  the  factors  are  XI, 
X2....XN  and  the  response  is  Y. 


RESPONSE  SURFACE 


ROOT  SUM  SQUARE 
(RSS) 


ROTATABLE  DESIGN 


R-SQUARED 


TRIAL 


The  surface  in  N+l  dimensional  space 
represented  by  the  equation  Y  * 
F(X1,X2,...XN). 

The  square  root  of  the  sum  of  the 

squares  represented  by  the  formula: 

N  2  1/2 

E  x, 
i=l  1 

A  central  composite  design  that  leaves 
the  variance  of  the  estimated  response 
to  be  approximately  constant  throughout 
the  sphere  of  radius  one. 

Small  r-Squared— refer  to  Correlation 
Coefficient 

Big  R-Squared— refer  to  Correlation 
Index. 

A  single  set  of  factor  values  applied 
to  the  experimental  subject  for  which 
the  response  is  measured. 
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INTRODUCTION 


The  Air  Force  Aerospace  iiei.lcal  Research  Labortory  (AFAMRL)  is  engaged  in  the 
use  of  human  operators  to  perform  critical  systems  evaluation.  The  size  and 
complexity  of  the  various  systems  preclude  the  detailed  analysis  that  would 
enable  AMRL  to  examine  each  aspect  of  every  system.  Large  numbers  of  factors 
(Independent  variables)  are  commonly  encountered  in  real-world  simulation  or 
field  problems.  Complete  full  factorial  experimental  designs  for  problems 
involving  large  numbers  of  factors  (20  factors  are  not  uncommon)  are  very 
costly  in  time,  manpower,  and  other  test  resources. 

The  use  of  fractional  factorial  designs  permits  the  experimenter  to  employ 
sequential  experimental  design  techniques.  See  Cochran  and  Cox  (1957)  and 
other  references  for  a  complete  discussion  of  fractional  factorial  experimental 
designs.  In  this  procedure,  the  various  factors  are  examined  and  a  potentially 
significant  subset  is  defined.  By  using  the  proper  aliasing  of  effects,  a 
small  fractional  factorial  experiment  can  be  conducted.  If  additional 
effects/interactions  are  identified  as  being  highly  significant  or  if  additional 
Interactions  are  required  to  be  examined,  a  larger  fractional  factorial  design 
can  be  constructed  by  removing  some  of  the  aliasing  requirements.  This  process 
of  designing  an  experiment,  data  analysis,  and  design  refinement  is  the  basis 
of  sequential  experimental  design. 

Examples  of  multivariable  design  problems  can  be  found  in  many  Air  Force  and 
other  R&D  programs,  e.g.,  Aume,  Mills,  et  al.,  1977.  AIWL  has  been  studying 
these  experimental  design  problems  for  a  number  of  years,  including  the  studies 
performed  by  Simon  (1973),  Mills  &  Will Iges  (1973),  and  Will iges  &  Mills  (1973, 
1979)  relating  to  human  factors  experimentation.  This  report  represents  an 
effort  to  implement  some  of  the  design  strategies  previously  proposed. 

Human  factors  experimentation  is  an  especially  critical  area  of  research 
because  the  experimenter  must  consider  the  factors  in  the  system  being  studied 
and  the  variations  Introduced  by  the  presence  of  a  human  subject.  To  overcome 
these  perturbations,  the  experimental  procedure  must  be  run  many  times  with 
several  different  subjects  to  remove  effects  caused  by  the  subjects  and  to 
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Identify  variations  caused  by  the  parameters  being  studied.  Since  this  proce¬ 
dure  requires  a  large  number  of  experimental  trials  (e.g.,  observations,  tests, 
etc.).  It  may  not  be  feasible  to  conduct  a  study  because  of  cost  and  time. 

One  way  to  overcome  this  problem  Is  to  employ  a  set  o"  experimental  designs 
called  fractional  factorial  experimental  designs.  Fractional  factorial  experi¬ 
ments  are  a  special  class  of  reduced  data  collection  designs  that  allow  the 
user  to  perform  a  smaller  number  of  observations  than  would  be  required  in  the 
usual  experimental  procedures. 

This  effort  provides  the  reader  with  an  automated  tool  to  design  fractional 
factorial  experiments.  A  tape  of  the  User-Assisted  Automated  Experimental 
(Test)  Design  Program  (AEQ):  Version  II  source  listing  in  FORTRAN  4-Plus  can 
be  obtained  from  AFAMRL/HEF,  Attn:  Dr.  Robert  G.  Mills,  WPAFB,  OH  45433.  For 
the  purposes  of  this  report,  the  authors  assume  that  the  reader  possesses  at 
least  a  conceptual  knowledge  of  symmetrical  experimental  design  procedures 
including  fractional  factorials.  This  assumption  also  holds  true  for  the  user 
of  the  initial  version  of  the  computer  program  which  is  being  described.  However, 
a  long  range  objective  of  this  effort  is  to  eventually  develop  the  program  to  the 
extent  that,  via  the  interactive  mode,  the  program's  user  need  have  only  a  mini¬ 
mum  knowledge  of  experimental  design  computational  procedures,  the  primary  intent 
is  to  develop  the  computer  program  such  that  it  can  be  readily  applied  by  the 
engineering,  etc.,  community  that  is  involved  with  performing  simulator  and 
live  testing  of  systems.  It  should  also  be  noted  that  although  the  computer 
program  presented  herein  is  designed  to  assist  the  sequential  experimental  de¬ 
sign  process  ( i . e . ,  a  series  of  experiments),  it  can  also  be  used  to  create  a 
"one-shot"  experimental  design. 

this  report  provides  background  on  experimental  designs  and  the  mathematical 
formulations  implemented  in  the  computer  program.  A  discussion  of  how  an  ex¬ 
periment  should  be  conducted  is  contained  in  the  Philosophy  of  Experimental 
Design  section,  the  class  of  experimental  designs  known  as  fractional  factorial 
designs  is  described  along  with  the  terminology  involved,  the  concept  of  alias¬ 
ing,  the  evaluation  of  designs,  and  means  of  defining  basic  experimental  blocks. 
Screening  designs,  response  surface  designs,  polynomial  approximations  to  the 
response  surface,  central  composite  designs,  and  mixed  level  designs  are  also 
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discussed.  Brief  conmentarles  on  data  collections,  redesign,  and  Irregular  frac¬ 
tional  factorial  experiments  are  provided.  Some  predefined  fractional  factorial 
designs  including  optional  aliasing  selection  to  reduce  aliasing  of  main  and 
first-order  effects  are  presented.  A  selected  bibliography  of  books  and  reports 
that  present  more  detailed  information  on  these  topics  is  given  in  the  reference 
section.  An  appendix  provides  a  detailed  step-by-step  description  of  the  com¬ 
puter  program. 

this  report  is  an  update  of  a  previous  report  and  indicates  the  present  status 
of  the  automated  experimental  design  program  (AED).  the  AED  program  contains 
adequate  instructions  and  text  to  guide  the  user  in  its  operation  without  the 
assistance  of  this  report.  It  is  provided  as  an  aid  to  understanding  the 
mathematical  formulations  and  as  a  source  of  additional  examples  (Appendix). 

For  the  current  version  of  the  program,  the  following  is  a  summary  of  its 
present  capabilities. 

1.  Basic  full  or  fractional  designs  where 

(a)  2  level  designs  can  have  up  to  20  factors  with  a  maximum  of  256 
experimental  trials. 

(b)  3  level  designs  can  have  up  to  12  factors  with  a  maximum  of  243 
experimental  trials. 

(c)  5  level  designs  can  have  up  to  8  factors  with  a  maximum  of  125 
experimental  trials. 

K  L 

2.  2x3  mixed  level  designs  where 

(a)  The  combined  number  of  factors  for  both  levels  must  be  less  than  or 
equal  to  20  (K  +  U20)  with  a  maximum  of  256  total  experimental 
trials. 

(b)  Experimental  plans  for  combining  the  separate  levels  have  been 
developed  for  1/2,  1/3,  1/4,  1/6,  1/8,  1/9,  1/12,  1/16,  1/18,  and 
1/24  fractionations. 
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3.  Rotatable  and  non-rotatable  central  composite  designs. 


4.  22  predefined  stored  designs  for  2  levels. 

19  predefined  stored  designs  for  3  levels. 

5.  Assistance  in  generating  realizable  2  level  designs  for  1/2,  1/4,  1/8, 
and  1/16  fractionations. 

THE  PHILOSOPHY  OF  EXPERIMENTAL  DESIGN 

The  basis  for  an  experimental  design  philosophy  consists  of  six  steps: 

1.  Problem  recognition  and  initial  study 

2.  Preliminary  model  definition 

3.  Data  collection  plan  development 

4.  Data  collection 

5.  Data  analysis 

6.  Analysis  of  results  and  model  reformulation. 

In  the  first  step,  the  experimenter  recognizes  the  existence  of  a  problem. 

He  begins  a  nreliminary  study  to  identify  the  problem  bounds  and  its  associated 
parameters.  This  initial  study  provides  a  crude  model  of  the  system.  In  the 
second  step,  the  experimenter  examines  this  preliminary  model  and  identifies 
those  features  that  severely  affect  the  performance  of  the  system.  He 
designs  a  data  collection  plan  that  enables  him  to  test  the  previously 
hypothesized  significant  features.  Without  an  adequate  data  collection  plan, 
the  experimenter  may  arrive  at  erroneous  conclusions. 

Once  the  data  collection  plan  (called  the  experimental  design)  is  complete, 
the  experimenter  "collects"  the  data.  After  the  data  are  collected,  data 
analysis  is  performed.  Data  analysis  consists  of  the  standard  analysis  methods, 
e.g.,  analysis  of  variance  (ANOVA)  techniques  or  regression  analysis,  if  all 
factors  are  quantitative.  This  analysis  identifies  those  factors  that  account 
for  most  of  the  system  variation.  According  to  Pareto's  Principle,  80  percent 
of  the  variation  in  a  system  can  be  attributed  to  20  percent  of  the  factors. 
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After  the  data  analysis  Is  performed,  the  experimenter  redesigns  or  refines 
his  system  model  based  on  the  results  of  the  previous  experimentation.  This 
cycle  of  redesign,  data  collection,  and  analysis  continues  until  the  experimenter 
Is  satisfied  with  the  accuracy  of  his  results.  At  this  point,  he  draws  con¬ 
clusions  about  the  system  based  upon  the  experimentation. 

THE  NEED  FOR  DESIGNED  EXPERIMENTS 

An  experiment  is  conducted  to  provide  information.  An  experimenter  needs 
information  to  identify  problem  areas,  to  identify  important  factors,  and  to 
quantify  responses.  He  obtains  this  Information  by  collecting  data.  After 
problem  definition  is  complete,  the  first  step  in  an  experiment  is  to  define 
questions  that  need  to  be  answered.  Once  the  questions  are  identified,  an 
experiment  can  be  designed  to  aid  in  answering  those  questions.  The  key 
issue  is  that  an  experimenter  must  design  his  experiment  before  any  data  are 
collected. 

The  designer  of  an  experiment  must  consider  the  statistical  accuracy  and  the 
cost  of  the  experiment.  Statistical  accuracy  involves  the  proper  selection 
of  the  response  to  be  measured,  determination  of  the  number  of  factors  that 
influence  the  response,  the  selection  of  the  subset  of  these  factors  to  be 
studied  in  the  experiment  being  planned,  the  number  of  times  the  basic  experi¬ 
ment  should  be  repeated,  and  the  form  of  the  analysis  to  be  conducted. 

The  cost  of  an  experiment  includes,  among  many  other  factors,  expense  incurred 
by  running  a  single  experimental  condition  (observation),  analyzing  the  data, 
failing  to  meet  a  deadline,  availability  of  subjects,  and  most  importantly, 
perhaps  drawing  incorrect  conclusions  from  the  experiment.  Although  cost  as 
a  factor  Is  not  often  discussed  in  the  literature,  it  is  at  least  as  important 
as  considerations  of  statistical  accuracy.  In  an  attempt  to  minimize  the 
cost  of  an  experiment,  the  designer  usually  attempts  to  choose  the  simplest 
experimental  design  possible,  and  to  use  the  smallest  sample  size  consistent 
with  satisfactory  results.  Fortunately,  most  simple  experimental  designs  are 
both  statistically  efficient  and  economical,  so  that  the  designer's  efforts 
to  obtain  statistical  accuracy  usually  result  In  econorny. 


-12- 


EXPERIMENTAL  MODEL 


The  experiments  being  studied  In  a  factorial  experiment  are  called  fixed  effect 
models.  The  term  fixed  effect  Is  related  to  the  predefined  levels  that  the 
various  factors  may  assume.  Consider  two  factors,  A  and  6,  which  are  being 
studied  where  there  are  levels  for  treatment  A  and  Ng  levels  for 
treatment  B.  The  response  In  a  two-factor  experiment  may  be  described  by  the 
model: 

x1j  *  *  +  a1  +  *J  +  a61j  +  e1j 

1  *  1,  2,  ....  Na 

J  *  2 . NB 

where 

y  ■  overall  mean  effect 
Oj  *  true  effect  of  the  1th  level  of  factor  A 
*  true  effect  of  the  jth  level  of  factor  B 
(oB)ij*  effect  of  the  Interaction  between  and  B^ 
eij  3  *Pe»*ln»enta1  error 

A  similar  model  for  three  factors  may  be  written  as: 

*uk  ■ » *  ai  *  6j  ♦  \ 4  (a6>)j  *  *  1®%  *  <“BY>ijk  *  Eijk 

The  assumptions  in  a  full  factorial  experiment  allow  for  the  examination  of 
each  main  effect  and  all  interactions.  A  fractional  factorial  experiment 
assumes  that  the  high-order  Interactions  are  Insignificant.  For  example,  in 
the  three-factor  model.  If  the  assumption  Is  made  that  the  Interactions  (ay), 
(By),  and  (aBy)  are  Insignificant,  the  model  becomes: 

X,jk  ■  u  *  a,  *  6j  *  rk  ♦  (««y  ♦  e1jlt 

This  permits  fewer  experimental  observations  to  determine  the  relative  signifi¬ 
cance  of  the  remaining  terms  In  the  model.  The  effects  considered  to  be 
Insignificant  are  Included  In  the  model  error  term. 
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This  experimental  model  can  be  evaluated  using  the  standard  analysis  of 
variance  (ANOVA)  techniques  or  a  regression  analysis  may  be  run.  If  all  factors 
are  quantitative,  to  determine  regression  coefficients. 


NOMENCLATURE— NOTATION  AND  TERMINOLOGY 

The  previous  section  showed  that  responses  could  be  modeled  as  equations 
involving  true  effects  of  each  factor  at  the  level  involved,  the  effects  of 
the  interactions  among  factors,  the  overall  mean  effect,  and  the  true  test 
(experimental)  error.  The  techniques  for  manipulating  response  data  from 
individual  experimental  trials  to  arrive  at  estimates  of  the  values  for  each 
of  the  terms  in  the  mathematical  model  involve  consideration  of  response  values 
for  various  combinations  of  factors  and  levels.  Two  standard  means  of  notation 
are  used  to  represent  these  response  values.  These  are  illustrated  in  the 
following  example. 

Consider  an  experiment  involving  three  factors  with  each  factor  having  two 
possible  levels.  If  the  factors  are  represented  by  a,  b,  and  c,  and  the  levels, 
by  0  and  1,  the  possible  trials  and  notations  used  to  represent  the  responses 
are  shown  in  Table  1. 

Table  1.  Full  Factorial,  Three-Factor,  Two-Level  Experiment 


EXPERIMENTAL  TRIAL 
(FACTOR  ANO  LEVEL) 

EFFECT  OR 
INTERACTION 

NOTATION 

Wo 

' 

OOO 

Wl 

C 

001 

•obieo 

B 

010 

Wl 

SC 

Oil 

•ibo*o 

A 

100 

Wi 

AC 

101 

•ibi«o 

AB 

110 

Wi 

ABC 

111 

Main  effects  are  represented  by  those  trials  whose  notation  has  a  nonzero 
value  in  only  one  column  of  the  notation.  Two-factor,  or  first-order  interac¬ 
tions,  are  represented  by  those  trials  whose  notation  has  a  nonzero  value  in 
two  columns.  Higher-order  interactions  are  represented  by  those  trials  whose 
notation  has  a  nonzero  value  in  more  than  two  columns.  In  this  example,  main 
effects  are  A,  B,  and  C.  First-order  interactions  are  AB,  AC,  and  BC.  The 
only  higher-order  interaction  is  ABC. 

It  is  apparent  from  Table  1  that  the  notation  consists  simply  of  the  subscripts 
representing  the  levels  of  the  factors  in  sequential  order  (thus,  trial  aobici 
has  a  response  notation  of  Oil).  The  effect  or  interaction  response  is  repre¬ 
sented  by  the  sequence  of  the  factors  raised  to  the  power  of  the  level  involved 
(thus,  trial  aob]ci  results  in  the  interaction  response  A^BlC^  =  BC). 

In  a  similar  manner,  effects  and  notations  can  be  defined  for  the  three-level 
case.  Consider  an  experiment  involving  three  factors  with  each  factor  having 
three  possible  levels.  If  the  factors  are  represented  by  a,  b,  and  c,  and 
the  levels  by  0,  1,  and  2,  the  possible  trials  and  notations  used  to  represent 
the  responses  are  shown  in  Table  2.  Note  that  the  main  effects  are  C,  C2,  B, 

B2,  A,  and  A2  because  the  notation  for  these  trials  has  a  nonzero  value  in 
only  one  column  of  the  notation. 

FRACTIONAL  FACTORIAL  EXPERIMENTS 

A  full  factorial  experimental  design  involves  an  experiment  in  which  every 
level  of  each  factor  is  combined  with  every  level  of  every  other  factor.  If 
an  experiment  has  N  factors  and  each  factor  may  assume  one  of  P  levels,  there 
is  a  total  of  pN  combinations. 

Table  3  is  an  example  of  an  experiment  with  three  factors  at  two  levels.  This 
example  is  taken  from  an  AMRL  study  of  the  MISVAL  program.  The  term  "MISVAL" 
designates  the  Missile  Launch  Envelope  Technology  Development  Program  being 
conducted  by  the  Air  Force  Wright  Aeronautical  Laboratories  at  Wright-Patterson 
Air  Force  Base,  Ohio.  The  definitions  of  factors  and  levels  used  in  the  examples 
are  not  considered  necessary  in  order  to  convey  the  Intent  of  the  examples. 
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Table  3.  MISVAL  Example 


LABSL 

FACTOR 

LOW  LEVEL  (0) 

HIOH  LEVSL  (11 

A 

MLE  CONCERT 

FAAC  CONCEPT 

QO  CONCEPT 

a 

PILOT  FUNCTION 

FUNCTION  1 

FUNCTION  2 

c 

MISSILE  TYPE 

AIM— 7F 

> 

i 

* 

The  23  =  8  combinations  of  these  factors  that  would  comprise  a  full  factorial 
experiment  for  the  MISVAL  program  are  given  in  Table  4. 


Table  4.  Full  Factorial  Experiment 


EXPERIMENTAL 

UNIT 

LABEL 

NOTATION 

MLE 

CONCEPT 

PILOT 

FUNCTION 

MISSILE 

TYPE 

1 

1 

000 

FAAC 

1 

AIM— 7F 

2 

C 

001 

FAAC 

1 

AIM— OF 

3 

B 

010 

FAAC 

2 

AIM— 7F 

4 

SC 

Oil 

FAAC 

2 

AIM— OF 

5 

A 

100 

GO 

1 

AIM— 7F 

8 

AC 

101 

GO 

1 

AIM— OF 

7 

AS 

110 

GO 

2 

AIM— 7F 

8 

ABC 

111 

00 

2 

AIM— OF 

Table  5  shows  the  number  of  observations  required  in  a  full  factorial  experiment 
for  experiments  with  2  to  10  factors  at  2  or  3  levels.  Note  that  the  number 
of  observations  required  rises  drastically  as  the  number  of  factors  and/or 
levels  increases. 

A  full  factorial  experimental  design  provides  an  estimate  of  every  possible 
effect,  i.e.,  one  Is  able  to  estimate  those  effects  caused  by  all  combinations 
of  factors.  In  many  experiments,  Interactions  among  factors  may  be  insignificant. 
Interactions  Involving  two  factors  are  called  first-order  interactions,  and 
Interactions  among  three  factors  are  called  second-order  Interactions. 


Table  5.  Full  Factorial  Experiment  Size 


N 

NUMMR  Of  FACTORS 

P-2 

LEVELS  PER  FACTORS 

P-3 

LEVELS  PER  FACTORS 

2 

4 

9 

3 

8 

27 

4 

IE 

81 

5 

32 

243 

6 

64 

729 

7 

128 

2187 

8 

2S8 

8861 

9 

512 

19SB3 

10 

1024 

59649 

In  many  human  factors  experiments,  the  assumption  that  second  and  higher-order 
interactions  are  insignificant  is  reasonable  (Simon,  1973). 

The  total  number  of  effects  and  interactions  is  given  by  PN  -  l.  The  number 
of  main  effects  is  given  by  (P  -  1)N.  The  number  of  first-order  interactions 
is  given  by: 

2 

(P-1) 

-  N(N— 1) 

2 

Thus,  the  number  of  higher-order  interactions  is  given  by: 

PN  -  1  -  (P  -  1)N  -  N ( N  -  1) 

Table  6  shows  the  number  of  main,  first-order,  and  higher-order  effects  for  a 
variety  of  factorial  experiments. 

Figure  1  shows  examples  of  the  groupings  of  main,  first-order,  and  higher-order 
effects  for  three  factors  at  two  and  three  levels. 


Table  6.  Effect/Interaction  Summary 


N 

NUMBER  OP  FACTORS 

P-2 

P-3 

LEVELS  PER  FACTOR 

LEVELS  PER  FACTOR 

MAIN 

EFFECTS 

1ST 

ORDER 

MAIN 

EFFECTS 

1ST 

ORDER 

HIGHER 

ORDER 

2 

2 

1 

0 

4 

4 

0 

3 

3 

3 

1 

6 

12 

8 

4 

4 

6 

5 

8 

24 

48 

S 

5 

10 

16 

10 

40 

192 

6 

8 

IS 

42 

12 

60 

ftCA 

090 

7 

7 

21 

99 

14 

84 

2088 

8 

8 

28 

219 

18 

112 

6432 

9 

9 

38 

466 

18 

144 

10 

10 

45 

968 

20 

180 

^9 

A  fractional  factorial  design,  sometimes  called  a  fractional  replication,  is 
a  portion  or  a  fraction  of  a  complete  factorial  experiment.  In  a  fractional 
replicate,  certain  interactions  cannot  be  separated  from  other  interactions. 
This  is  the  price  that  is  paid  for  reducing  the  number  of  experimental  trials. 
Interactions  or  effects  that  cannot  be  separated  are  said  to  be  aliased  or 
confounded. 

The  use  of  fractional  factorial  experiments  is  based  on  the  assumption  that 
higher-order  interactions  above  first-order  are  insignificant  and  need  not  be 
examined  in  detail.  For  example,  consider  an  experiment  in  which  main  effect 
A  is  aliased  with  interaction  BCD.  When  data  are  collected,  the  experimenter 
estimates  the  response  caused  by  effect  A  and  BCD  together.  There  is  no  way 
to  know  If  the  response  is  due  only  to  A  or  if  effect  BCD  plays  a  significant 
part  in  the  response.  Thus,  effects  A  and  BCD  are  not  separable.  The  assump¬ 
tion  in  a  fractional  factorial  experiment  is  that  the  contribution  caused  by 
BCD  would  be  negligible. 


TWO  LEVELS  PM  FACTOR 


MAIM  EFFECTS 


1ST— OK  OCR  INTIRACTIONS 


HIGHER— ORDER  INTERACTIOM 


THREE  LEVELS  PER  FACTOR 


MAIN  EFFECTS 


1ST— ORDER  INTERACTIONS 


ARC2 

AS^C 

AfV 

a2bc 

aV 

aVc 

aVc2 


HIGHER— ORDER  INTERACTIONS 


Figure  1.  Main  Effects  and  Interatlons 


A  full  factorial  experiment  Is  useful  when  an  experimenter  requires  that: 

1.  Every  main  effect  of  every  factor  be  estimated  Independently  of  every 
other  one. 

2.  The  dependence  of  the  effect  of  every  factor  upon  the  levels  of  the 
others  (the  Interactions)  be  determined. 

3.  The  effects  be  determined  with  maximum  precision. 

If  an  experimenter  does  not  require  this  level  of  detail,  or  if  faced  with 
time  or  budget  limitations  that  prohibit  a  full  factorial  experiment,  fractional 
factorial  designs  are  available.  The  primary  assumption  in  the  use  of  a  frac¬ 
tional  factorial  experiment  is  that  higher-order  interactions  are  insignificant. 
If  this  assumption  is  not  valid  for  a  particular  experiment,  a  fractional 
factorial  design  should  not  be  used.  In  most  human  factors  experiments,  however, 
this  Is  a  reasonable  assumption  and  can  result  in  a  significant  reduction  in 
the  number  of  experimental  (test)  trials  or  observations  required. 

Interactions  that  are  assumed  to  be  Insignificant  can  be  used  to  define  the 
aliasing  or  confounding  used  in  the  fractional  factorial  design.  The  concept 
of  aliasing  Is  discussed  in  the  next  section. 

ALIASING 

OVERVIEW 

Each  successive  step  in  fractionating  a  full  factorial  design,  or  dividing  it 
into  blocks,  requires  that  an  additional  effect  referred  to  as  a  defining 
contrast  be  defined  for  the  fractional  factorial  design.  A  defining  contrast 
Is  a  selected  observation  vector  whose  factor  combinations  will  not  be  Important 
to  the  experimentation.  Defining  contrasts  are  then  used  in  generating  the 
alias  set.  The  alias  set  Is  composed  of  all  factor  combinations  of  the  defining 
contrasts.  Thus,  a  two-level,  one-half  design  requires  one  defining  contrast 
to  be  defined  by  the  experimenter;  while  a  one-fourth  design  requires  two 
defining  contrasts,  and  so  on.  The  defining  contrasts  must  be  selected  by 
the  experimenter  to  meet  the  requirements  of  the  design. 
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The  selection  of  defi.-ing  contrasts  is  important  in  the  design  of  a  fractional 
factorial  experiment.  In  &  given  experiment,  the  value  of  aliased  terms  cannot 
be  estimated;  thus,  no  term  of  interest  to  the  experimenter  should  be  selected 
as  a  defining  contrast. 

Defining  contrasts  are  usually  selected  to  avoid  aliasing  main  effects  with 
other  main  effects.  In  a  sequential  design,  however,  it  may  be  desirable  to 
alias  two  main  effects.  For  example,  if  the  experimenter  suspects  that  two 
factors,  A  and  E,  are  not  significant,  he  might  design  the  first  pilot  experi¬ 
ment  so  that  A  and  E,  are  confounded.  If  the  data  from  this  pilot  experiment 
show  that  the  estimated  values  of  A  and  E  are  not  significant,  then  the 
experimenter's  suspicions  are  confirmed.  These  two  factors  can  be  dropped, 
thus  reducing  the  experiment  size  for  the  next  pilot  experiment. 

The  defining  contrasts  can  be  described  by  identities  that  determine  which 
effects  will  be  confounded,  the  experimenter  does  not  have  a  completely  free 
hand  in  the  selection  of  these  defining  contrasts.  Defining  contrasts  are 
linearly  independent  if  one  defining  contrast  is  not  a  factor  combination  of 
another.  Unless  the  selected  defining  contrasts  are  linearly  independent, 
some  factor  combination  of  one  defining  contrasts  will  be  the  same  as  a  factor 
combination  of  the  nonindependent  defining  contrasts  selected.  This  indicates 
that  the  nonindependent  defining  contrasts  is  redundant,  and  the  experimenter 
has  selected  fewer  defining  contrasts  than  planned.  This  results  in  a  larger 
experiment  block  size  than  desired.  In  this  case,  it  is  necessary  to  redefine 
the  nonindependent  defining  contrast  so  that  a  set  of  independent  defining 
contrasts  is  selected. 

The  following  paragraphs  provide  background  for  the  generation  of  the  alias 
set  and  development  of  alias  summaries.  These  operations  are  performed  within 
the  computer  proqram,  and  understanding  of  this  material  is  not  necessary  to 
use  the  program. 

OPERATIONS  WITH  ALIASES 

Assuming  each  of  N  factors  will  be  varied  over  P  levels,  the  set  of  fractional 
factorial  experiments  considered  here  is  the  1/pM  designs,  where  M  is  a 
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positive  integer.  Thus  two-level  designs  might  be  1/2,  1/4,  1/8,  1/16,  etc. 
Three-level  designs  might  be  1/3,  1/9,  1/27,  1/81,  etc.  In  general,  a  1/p^ 
design  requires  M  defining  contrasts.  Specifying  the  defining  contrasts  is 
an  important  problem  in  designing  fractional  factorial  experiments.  One  way 
to  specify  the  defining  contrasts  is  to  describe  which  effects  are  to  be 
confounded. 

Although  confounding  two  factor  interactions  with  other  two  factor  interactions 
is  not  always  desirable  in  a  good  experimental  design,  this  will  be  done  in 
the  following  examples  for  ease  of  calculation  and  demonstration.  If  effects 
AB  and  CD  are  to  be  confounded,  the  user  may  specify  the  defining  contrast  as 
AS  =  CD.  Defining  contrasts  may  also  be  described  in  terms  of  the  identity 
effect,  I.  This  is  accomplished  by  multiplying  both  sides  of  the  equation  in 
this  example  by  AB,  yielding  a2b2  =  ABCD.  Assuming  a  two-level  problem,  apply 
modulo  2  arithmetic  to  the  exponents  of  the  factors  a2b2  =  aOb°  =  I  =  ABCD. 

If  the  effects  to  be  confounded  are  a2b  =  CD  in  a  three-level  problem,  first 
multiply  both  sides  by  a2b  using  module  3  arithmetic  on  the  exponents.  Modulo  P 
is  merely  the  remainder  when  the  number  is  divided  by  P  (e.g.,  4  modulo  3=1, 

12  modulo  3  =  0,  13  modulo  3=1,  etc.). 

This  gives 

(A2B)(A2B)  =  A2BCD 
a4b2  =  AB2  =  A2BCD 

Multiply  both  sides  again  by  a2b,  giving  (AB2)(a2b)  =  (a2bCD)(A2B) 

or  A3B3  =  I  =  A*b2CD  =  AB2CD 
or  I  =  Afi2CD. 

Each  effectwill  be  aliased  with  (pM  -  1)  other  effects.  For  l/pM  designs,  M 
must  be  less  than  or  equal  to  (N  -  1).  As  the  number  of  defining  contrasts 
increases,  the  number  of  effects  aliased  with  each  effect  increases  rapidly 
as  shown  in  Table  7. 


Table  7.  Number  of  Effects  Aliases 


OESIGN 

P- 

NO.  OF  LEVELS 

2 

1/4 

2 

1/8 

2 

1/16 

2 

1/32 

2 

1/64 

2 

1/128 

2 

1/3 

3 

1/9 

3 

1/27 

3 

1/81 

3 

1/243 

3 

1/729 

3 

1/2187 

3 

NO.  OF 

DEFINING 

CONTRASTS 

NO.  OF  EFFECTS 

ALIASED  WITH  EACH  EFFECT 

1 

1 

The  number  of  effects  aliased  with  each  effect  (such  as  a  main  effect)  increases 
rapidly  as  smaller  fractional  factorial  designs  are  considered.  Thus,  as  the 
number  of  defining  contrasts  (M)  increases  without  a  corresponding  increase  in 
the  number  of  factors  (N),  it  becomes  difficult  to  select  defining  contrasts 
that  avoid  aliasing  main  effects  with  other  main  effects  in  this  case. 


The  total  alias  combination  set  may  be  generated  by  considering  all  combinations 
of  all  powers  of  the  individual  defining  contrasts  from  1  to  the  (P  -  l)th 
power.  Thus,  if  a  two-level  experiment  is  being  considered  (P  *  2),  only  the 
first  power  of  the  defining  contrasts  is  considered  in  deriving  the  alias 
set.  For  a  three-level  experiment  (P  =  3),  both  first  and  second  powers  of  the 
defining  contrasts  are  considered  in  deriving  the  alias  set. 


For  example,  consider  a  three-level  experiment  involving  four  factors 
(P  -  3,  N  =  4).  Suppose  M  is  selected  as  a  value  of  3,  resulting  in  a  1/27 


design.  From  the  tabulation,  we  find  that  three  defining  contrasts  are  required 
and  each  effect  will  be  aliased  with  26  effects  or  interactions.  The  alias 
set  may  be  derived  by  representing  all  the  integers  from  1  to  (pM  -  1)  in 
base  p  arithmetic  representation  (1  to  26  in  this  example  expressed  in  base  3 
arithmetic). 


1 

3 

001 

10 

s 

101 

19 

= 

201 

2 

= 

002 

11 

3 

102 

20 

= 

202 

3 

* 

010 

12 

= 

110 

21 

3 

210 

4 

3 

Oil 

13 

= 

111 

22 

= 

211 

5 

= 

012 

14 

3 

112 

23 

3 

212 

6 

3 

020 

15 

= 

120 

24 

= 

220 

7 

3 

021 

16 

3 

121 

25 

3 

221 

8 

* 

022 

17 

3 

122 

26 

3 

222 

9 

3 

100 

18 

3 

200 

Each  digit  of  the  base  3  representation  is  used  as  the  power  to  which  each  of 
the  three  defining  contrasts  is  raised.  For  example,  the  combination  121 
indicates  that  the  first  and  third  defining  contrasts  are  raised  to  the  first 
power  while  the  second  defining  contrast  is  squared. 

From  this  list,  only  those  combinations  that  are  in  standard  form  are  used, 
since  the  other  combinations  will  result  in  duplications.  A  combination  is 
in  standard  form  if  the  leading  nonzero  exponent  is  1.  Thus,  120  is  in  standard 
form  whereas  210  is  not. 

In  our  example  (P  *  3,  N  *  4,  M  *  3),  let  us  specify  the  defining  contrasts 
selected  as  I  =  ABCD  =  B2c2d  =  A2B.  The  tabulation  of  combinations  is  shown 
in  Table  8.  Note  that  the  exponents  are  reduced  modulo  P  to  arrive  at  the 
final  alias  combinations.  Thus,  (A2b)2  =  A^B2  =  AB2  modulo  3. 

In  our  example  for  our  experiment  design,  we  assigned  three  defining  contrasts. 
The  total  alias  set  was  then  derived  (26  in  this  case),  which  represents  the 
combinations  applicable  to  this  design.  The  experimenter  must  now  be  concerned 
with  how  the  individual  effects  and  interactions  are  aliased. 
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Table  8.  Total  Alias  Set 


rows*  sit 

MFININQ  CONTRAST 
COMBINATION 

TOTAL 
ALIAS  SET 

001 

A*S 

A*8 

002 

(A2*)* 

AS2 

010 

S“0 

Oil 

(■JCaOI(AJOI 

a2c2o 

012 

(B2C2DHA2SI2 

asA 

020 

(•^t2 

SCO2 

021 

(»2C2O)2(A20l 

aVco2 

022 

(«2C2OI2<A2tl2 

ACO2 

100 

ASCO 

ASCO 

101 

<A8COI(A2S) 

8*00 

102 

(ASCOMA29)2 

A*CO 

110 

iaocomo2c2oi 

AO2 

111 

IASCOM02C2OMA2ai 

BO2 

112 

(AOCOMS2C2OI(A2tl2 

aV 

120 

(ascokoVoi2 

ASV 

121 

(ASCOI(S2C2OI2tA2S> 

C2 

122 

(AiCOHS2C2OI2(A2OI2 

A^OC2 

200 

(ASCOI2 

A*8*C*D- 

201 

lASCO^A2*! 

AC2©2 

202 

ASCOI^A2**2 

__2_3 

tc*o* 

210 

(A0CO12(t2C2O> 

A2* 

211 

(AOC012(«2CaOI(A2B» 

AS^ 

212 

<ASCOI2<S2C2OMA2tl2 

c 

220 

(ascoi2io2c2oi2 

A2© 

221 

(ASCOI2<02CaOI2(A2OI 

ASO 

222 

IASCOI2(02C2O)2(A20l2 

8*0 

ALIAS  SET  GENERATION  IN  TWO  LEVEL  DESIGNS 

The  alias  set  for  a  given  fractional  factorial  design  may  be  selected  to  meet 
the  objectives  of  the  experimenter  within  certain  constraints.  For  example, 
if  it  is  known  that  two  factors,  A  and  B,  are  not  significant,  the  experimenter 
may  choose  to  deliberately  confound  these  effects  and  select  one  defining 
contrast  as  AB.  Obviously,  it  is  not  possible  to  develop  guidelines  for  every 
case  which  might  arise.  Since  a  large  portion  of  possible  experimentation  is 
directed  toward  screening  or  the  identification  of  significant  factors,  emphasis 
has  been  placed  on  examining  the  selection  of  aliases  for  isolation  designs 
in  which  factors  of  interest  are  not  confounded  with  other  factors  of  interest 
so  their  significance  can  be  determined. 

Generally,  in  a  two-level  experiment  involving  N  factors,  it  is  desired  to 
isolate  all  single  factors  and  two  factor  interactions.  This  is  under  the 
assumption  that  three  factor  and  higher  order  interactions  are  insignificant. 

For  this  situation  to  exist,  all  members  of  the  alias  set  must  contain  a  minimum 
of  five  factors.  There  will  be  cases  in  which  this  cannot  be  achieved  (e.g., 
an  experiment  which  involves  fewer  than  five  factors). 

To  obtain  the  largest  degree  of  isolation  for  a  given  experiment,  all  members 
of  the  alias  set  should  contain  approximately  the  same  number  of  factors  that 
are  at  their  high  level. 

Given:  N  =  number  of  factors 

M  *  fractionation  measure  (fraction 
S  =  number  of  members  of  alias  set 
Then:  S  =  2”  -  1 

I  =  maximum  number  of  factors  which 
of  the  alias  set  can  contain 

=  2M-1n. 

To  illustrate,  consider  a  1/8  fractionation  of  a  2$  experiment. 

Here  N  =  5,  M  =  3  (p  =  5) 


the  summation  of  all  members 
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S  *  23  -  1  «  7  members  of  alias  set 
£  =  22x5-4x5-20  factors 

In  this  example,  the  seven  members  of  the  alias  set  will  contain  a  maximum  of 
20  factors.  The  alias  set  can  consist  of  either  S  members,  each  of  which  has 
an  even  number  of  factors,  or  S+l  members  containing  an  odd  number  of  factors 
and  members  containing  an  even  number  of  factors.  In  our  example,  the 
total  alias  set  may  thus  consist  of  either: 

(a)  7  members  each  containing  an  even  number  of  factors.  The  summation 
should  equal  20.  An  example  would  be  five  members  of  2  factors, 
one  member  of  4  factors,  and  one  member  of  6  factors.  This  is 
represented  as: 

5(2)  +  (4)  +  (6)  *  20 

A  better  example  for  this  case,  in  terms  of  having  all  members  of  the  alias 
set  with  as  close  to  the  same  number  of  factors  as  possible  would  be 
4(2)  +  3(4)  =  20 

(b)  4  members  containing  an  odd  number  of  terms,  and  3  containing  an 
even  number  of  terms.  For  our  example,  this  would  be 

2(2)  +  4(3)  +  1(4)  =  20. 

For  our  sample  case,  the  alias  set  design  in  (b)  Is  better  than  that  in  (a) 
in  that  (b)  only  has  two  2  factor  members  while  (a)  has  four  2  factor  members. 
The  quality  of  an  alias  set  design  may  be  quantified  by  determining  the  root 
sum  square  (RSS)  of  the  departure  from  the  mean: 

Mean  B  T  members  *  2,857  factors/raen*,er 

S  -  2  1/2 

Quality  *  z  (x  -  x)  ,  where  x  *  number  of  factors  for  the  1th  case 
1-1  1 


I 


x  *  means,  and  S  *  number  of  members  of  the  alias  set. 

Quality  (a)  -  4(2-2.857)2  +  3(4-2.857)2  1/2  -  6.856  1/2  •  2.619 

Quality  (b)  *  2(2-2.857)2  +  4(3-2. 857)2  +  l(4-2.857)2  1/2  *  2.856  1/2  ! 

=  1.690  1 

Thus  the  members  of  alias  set  design  (b)  are  clustered  nearer  the  mean  than 
the  members  of  (a)  are. 

THEORETICAL  "BEST"  ISOLATION  DESIGNS  ? 

From  the  rules  In  the  preceding  section.  It  Is  possible  to  formulate  the  "best" 
theoretical  Isolation  designs.  "Best,"  In  this  context,  means  that  the  members 
of  the  alias  set  contain  as  close  to  the  same  number  of  high  level  factors  as 
possible.  These  theoretical  designs  are  presented  in  Tables  9  through  20  for 
the  range  of  values  of  M  and  N  which  are  included  In  the  two  level  design 
portion  of  the  AED  program. 


Table  16 


8.  255  Members  of  Allas  Set 


Table  19.  M  *  11.  2047  Members  of  Alias  Set 


LN 

2 

3 

MM 

5 

8 

m 

8 

mm 

10 

11 

mm 

509 

1023 

515 

El 

1020 

1024 

3 

m 

14 

508 

1024 

515 

■ 

15 

| 

1023 

B 

16 

Q 

1023 

17 

■ 

1019 

'  ' ; : 

4 

18 

■ 

F  1 

1024 

516 

19 

■ 

■ 

1019 

1023 

5 

Table  20.  M  =  12.  4095  Members  of  Alias  Set 


MM 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

igg 

2044 

2048 

3 

El 

1020 

2048 

1027 

15 

2044 

2047 

4 

18 

1020 

2047 

1028 

17 

2043 

2048 

4 

18 

1019 

2048 

1028 

19 

2043 

2047 

5 

20 

1019 

2047 

Ea 

To  illustrate  the  use  of  the  tables,  consider  the  previous  example  with  M  =  3 
and  N  *  5.  In  Table  11  headed  M  *  3,  in  the  row  for  N  a  5,  we  find  the  number 
2  under  the  column  headed  "2,"  the  number  4  under  the  column  headed  "3,"  and 
the  number  1  under  the  column  headed  "4."  This  is  read  as 

2(2)  =  4(3)  +  1(4) 

The  optimum  Isolation  design  for  this  case  would  result  in  an  alias  set  conaining 
two  members  consisting  of  two  factors,  four  members  consisting  of  three  factors. 


and  one  member  consisting  of  four  factors.  Since  the  alias  set  contains  two 
factor  terms,  it  is  not  possible  to  isolate  main  effects. 


From  inspection  of  Tables  9  through  20,  it  can  be  seen  that  within  the  constraints 
of  the  AED  program  (number  of  trials  £  256)  and  realizability,  for  a  given 
value  of  M,  the  number  of  factors  must  equal  or  exceed  the  number  shown  in 
the  following  table  to  permit  isolating  all  main  and  two  factor  effects: 


M 

1 

5 

2 

8 

3 

10 

4 

11 

5 

11 

6 

11 

7 

11 

8 

11 

9 

11 

10 

12 

11 

12 

12 

13 

Alternatively,  for  a  given  value  of  N  (number  of  factors),  the  allowable  values 
of  M  are  shown  in  the  following  table  to  permit  complete  isolation  of  main 
and  two  factor  interactions: 


N 

M_ 

2 

Not 

possible 

3 

Not 

possible 

4 

Not 

possible 

5 

M  = 

1 

6 

M  * 

1 

7 

M  = 

1 

8 

M  » 

1.2 
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9  M  *  1,2 

10  M  =  2,3 

11  M  *  3,4,5,6,7,8,9,10 

12  M  *  4,5,6,7,8,9,10,11 

13  M  =  5,6,7,8,9,10,11,12 

14  M  =  6,7,8,9,10,11,12 

15  M  =  7,8,9,10,11,12 

16  M  *  8,9,10,11,12 

17  M  *  9,10,11,12 

18  M  =  10,11,12 

19  M  =  11,12 

20  M  =  12 

Similar  tables  could  be  constructed  for  isolation  of  main  effects  only  (all 
members  of  alias  set  contain  at  least  four  factors),  isolation  of  main,  two 
factor,  and  three  factor  interactions  (all  members  of  the  alias  set  contain 
at  least  six  factors),  etc. 

REALIZABLE  DESIGNS 

All  of  the  designs  presented  in  the  Tables  9  through  20  are  not  realizable, 
particularly  in  those  cases  in  which  M  approaches  N.  However,  inspection  of 
the  theoretically  best  isolation  designs  will  show  if  the  desired  results  in 
terms  of  isolation  could  be  obtained  if  the  design  can  be  found.  If  the  design 
is  not  adequate,  perhaps  more  trials  should  be  added  (reduce  M)  to  improve 
the  isolation.  If  the  table  design  is  adequate,  the  next  step  is  to  determine 
if  the  design  is  stored  in  the  AED  program.  The  designs  stored  in  the  AED 
program  are  the  best  realizable  isolation  designs  that  have  been  found  to 
date. 


If  the  desired  design  does  not  reside  in  the  AED  program,  a  realizable  design 
can  be  constructed  following  the  procedure  described  in  the  next  section. 
Variants  of  this  procedure  can  also  be  used  to  modify  stored  designs  to  meet 
special  needs  of  the  experimenter. 
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ALIAS  SET  MODIFICATIONS  AND  THE  GENERATION  OF  NEW  DESIGNS 
The  alias  set  is  generated  by  developing  all  of  the  possible  combinations  of 
the  defining  contrasts.  As  an  example,  if  three  defining  contrasts,  (M  ®  3), 
say  AB,  BC,  and  CO  are  used  in  a  four  factor  problem  (N  *  4),  the  resulting 
alias  set  is  generated  as  follows: 


1 

Defining  Contrast  No. 

1  =  AB 

1100 

2  factors 

2 

Defining  Contrast  No. 

2  =  BC 

0110 

2  factors 

1x2 

Product  of  1  and  2 

=  AC 

1010 

2  factors 

3 

Defining  Contrast  No. 

3  =  CD 

0011 

2  factors 

1x3 

Product  of  1  and  3 

=  ABCD 

1111 

4  factors 

2x3 

Product  of  2  and  3 

=  BD 

0101 

2  factors 

1x2x3 

Product  of  1,2,  and  3 

=  AD 

1001 

2  factors 

This  is  a  6(2)  +  1(4)  design 

A  new  design  for  N  =  5  can  be  built  from  this  design  by  adding  another  column. 
The  goal  should  be  to  increase  the  two  factor  terms  and  not  increase  the  four 
factor  (1x3)  term. 

This  can  be  done  as  follows: 


Contrast 

Original 

Added 

Product 

Design 

Column 

1 

1100 

1 

3  factors 

2 

0110 

1 

3  factors 

Contrast 

Original 

Added 

Product 

Desiqn 

Column 

12 

1010 

0 

2  factors 

3 

0011 

1 

3  factors 

13 

1111 

0 

4  factors 

23 

0101 

0 

2  factors 

123 

1001 

1 

3  factors 

This  results  in  a  2(2)  +  4(3)  +  1(4)  design  for  N  s  5  which  means  the  best 
theoretical  design  from  Table  11  for  N  =  5  and  M  *  3. 
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The  defining  contrasts  for  this  design  are: 

11001  =  ABE 
01101  *  BCE 
00111  =  CDE 

Now  assume  we  wish  to  build  a  design  for  N  *  6.  This  can  done  by  generating 
another  new  column.  The  new  column  should  Increase  the  two  factor  terms  (1x2 
and  2x3)  and  not  Increase  the  four  factor  term  (1  x  3).  This  will  result 
in  the  following  design: 


Contrast 

5  Factor 

Added 

Product 

Design 

Column 

1 

11001 

0  3  factors 

2 

01101 

1  4  factors 

12 

10100 

1  3  factors 

3 

00111 

0  3  factors 

13 

11110 

0  4  factors 

23 

01010 

1  3  factors 

123 

10011 

1  4  factors 

This  results  in  4(3)  +  3(4)  design,  which  again  is  a  best  isolation  design. 

In  general,  as  M 

increases,  this 

procedure  will  not  result  in  best  isolation 

designs,  but  all  designs  will  be 

achievable. 

The  process  can  be  used  in  reverse  by  removing  columns.  In  fact,  a  poor  design 
can  be  improved  by  removing  columns,  then  adding  columns  by  paying  attention 

to  the  numbers  of 

factors  in  the 

rows.  To  illustrate,  assume  the  following 

ten  factor  design 

is  available: 

Contrast 

10  Factor 

Product 

Design 

1 

1111110000 

6  factors 

2 

0001111100 

5  factors 

12 

1110001100 

5  factors 

3 

1101010011 

6  factors 

13 

0010100011 

4  factors 
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23 

123 


1100101111 

oononm 


7  factors 
7  factors 


this  is  a  1(4)  +  2(5)  +  2(6)  +  2(7)  design,  the  first  step  is  to  reduce  this 
to  a  nine  factor  design  by  removing  a  column.  Columns  3,5,9,  and  10  should 
not  be  removed  since  this  would  reduce  the  four  factor  member  (1  x  3).  In  the 
same  manner,  columns  3,4,  and  6  should  not  be  removed  since  the  seven  factor 
term  (2  x  3)  would  not  be  reduced.  Also  columns  1,  2,  and  5  should  not  be  re¬ 
moved  since  this  would  not  reduce  the  seven  factor  term  1x2x3.  this  leaves 
columns  7  and  8  as  candidates  for  removal.  Removing  column  7,  we  are  left  with 
a  nine  factor  design.  A  new  column  can  then  be  added  as  shown,  which  now  results 
in  a  best  ten  factor  design. 


Contrast 

Product 

Resulting  9  Factor 
Design 

Factors 

Added 

Column 

Factors 

1 

111111000 

6 

0 

5 

2 

0001  111  00 

4 

1 

5 

12 

111000100 

4 

1 

5 

3 

11 01 01 01 1 

6 

1 

7 

13 

001 01 001 1 

4 

1 

5 

23 

11 001 0111 

6 

0 

6 

123 

001101111 

6 

0 

6 

the  nine  factor  desigr  is  a  3(4)  +  4(6)  design,  the  new  ten  factor  design  is 
a  3(5)  +  3(6)  +1(7)  design  as  compared  with  our  starting  point  of  a  1(4)  + 
2(5)  +  2(6)  +  2(7)  design,  thus,  we  have  arrived  at  a  much  improved  design. 
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ALIAS  SUMMARY 


the  primary  concern  of  the  experimenter  is  directed  toward  examining  how  all  main 
effects  and  first-order  interactions  are  aliased,  the  aliasing  for  any  effect  can 
be  found  by  multiplying  the  effect  by  the  total  alias  set  (applying  modulo  P  arith¬ 
metic  to  the  factor  exponents). 

For  example,  consider  a  design  consisting  of  6  factors  each  at  2  levels  with  an 
M  of  2.  this  is  a  one-fourth  design,  and  two  defining  contrasts  must  be  specified 
by  the  experimenter.  Assume  that  the  identities  selected  are  I  =  ABCE  =  ABDF. 
Following  the  rules  given  in  the  previous  sections,  we  find  that  each  effect  is 
aliased  with  three  effects;  and  the  complete  alias  set  consists  of  ABCE,  ABDF,  and 
CDEF.  the  main  effects  and  first-order  interactions  and  how  they  are  aliased  are 
illustrated  in  Table  21. 

Individual  effects  or  interactions  can  be  examined  by  multiplying  the  particular 
effect  by  each  member  of  the  alias  set.  For  example,  with  I  =  ABCE  =  ABOF  = 

CDEF,  the  interaction  EF  can  be  found  to  be  aliased  as: 

( I )  (EF)  =  (ABCOHEF)  =  (ABDF)  (EF)  =  (CDEF)  (EF) 

EF  =  ABCE2F  =  ABDEF2  «  CDE2F2 
EF  =  ABCF  =  ABDE  =  CD 

when  all  exponents  are  reduced  modulo  2. 
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sera 


If  the  experiment  becomes  large,  it  may  be  difficult  to  read  the  alias  summary 
as  shown  in  Table  21.  Therefore,  an  abbreviated  summary  (Table  22)  is  provided 
to  show  how  much  main  effect  and  first-order  interaction  is  aliased  with  main 
effects  and  first-  and  higher-order  interactions.  An  exmaination  of  this 
table  shows  that  all  main  effects  are  aliased  only  with  higher-order  interactions. 
This  is  an  acceptable  design  for  a  fractional  factorial  experiment.  Refer  to 
Table  9  to  find  the  specific  aliased  terms.  The  particular  design  acceptability 
criteria  depend  upon  the  problem  being  studied. 

DESIGN  EVALUATION 

Once  the  alias  summary  has  been  generated,  the  experimenter  must  determine  if 
the  design  is  acceptable.  The  acceptability  of  a  design  depends  upon  the 
aliasing  of  those  effects  assumed  to  be  significant  by  the  experimenter.  If 
an  insignificant  effect  is  aliased  with  a  significant  effect,  the  design  is 
considered  to  be  a  good  design.  If  a  few  significant  effects  are  aliased, 
however,  the  user  may  define  another  design  or  he  might  use  the  current  design 
and  let  the  data  analysis  indicate  if  an  effect  that  consists  of  the 
combination  of  two  potentially  significant  effects  is  significant.  If  a 
combined  effect  is  significant,  the  design  can  be  refined  to  perform  the 
required  effect  separation  (refer  to  Section  8,  Refining  Designs). 

Once  an  acceptable  design  has  been  generated,  the  specific  observation 
vectors  used  to  collect  data  must  be  found.  This  collection  of  observation 
vectors  is  called  the  basic  experimental  block. 

BASIC  BLOCK  DEFINITION 

Once  the  total  alias  set  has  been  defined,  the  specific  treatment  combinations 
used  to  collect  data  must  be  found.  The  details  of  the  construction  of  this 
block  may  be  skipped  by  the  novice  user. 

The  M  members  of  the  defining  contrast  set  are  used  to  generate  the  block  of 
treatments  and  are  consequently  called  generators.  If  the  generators  are 
denoted  by 
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•» 


Si  =  Aai8bicci...  1  ■  1,  2,  .... 


M, 

then  the  levels  in  the  factorial  combination  xjx2X3  ...  selected  for  the  block 
satisfy  simultaneously  the  M  equations 

aixi  +  biX2  +  Cix3  +  ...  =0  (modulo  P) 

i  =  1,2,  ...»  M 

Similar  equations  in  which  1,  ....  (P  -  1)  is  used  in  place  of  0  are  equally 
valid;  however,  the  set  of  treatments  defined  using  the  0,  called  the  Basic 
Block  or  the  principal  block,  will  be  used  here. 

Consider  the  one-fourth  replicate  of  an  experiment  with  six  factors  at  two 
levels,  where  the  defining  contrasts  are  I  *  ABCD  =  ABDF.  (The  total  alias 
set  is  I  =  ABCO  *  ABDF  *  CDEF.)  The  defining  contrasts  define  two  generating 
equations: 

Gi  =  AlBlciDOElfO 
G2  *  AlBlcODlEOpl 

The  simultaneous  equations  to  be  solved  are: 

xi  +  X2  +  X3  +  X5  =0  modulo  2 
xi  +  X2  +  X4  +  X6  =  0  modulo  2 

Each  of  the  26  =  64  factor  combinations  is  evaluated  using  this  system  of 

equations,  and  those  combinations  satisfying  the  equations  form  the  basic 
experimental  block.  Table  23  shows  all  26  treatment  combinations,  and  the  16 
that  form  the  basic  block  are  shown  with  an  asterisk. 

The  basic  block  (or  observation  vector)  for  the  example  is  given  In  Table  24. 

Note  that  0  indicates  the  factor  is  at  Its  low  level  whereas  a  1  indicates  a 
factor  is  at  its  highest  level.  Once  the  basic  block  Is  defined,  the  experi¬ 
menter  must  collect  the  experimental  data.  Data  collection  procedures  are 
discussed  in  the  next  section. 
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DATA  COLLECTION 


Using  the  observation  vectors  defined  in  the  basic  experimental  block,  the 
data  collection  process  is  relatively  straightforward.  The  different  combina¬ 
tions  in  the  basic  block  are  tested,  and  the  response  value  is  measured. 

No  consideration  has  been  given  to  the  specific  order  in  which  the  observation 
vectors  are  to  be  run.  The  general  procedure  is  to  select  random  combinations 
until  each  of  the  observation  vectors  in  the  basic  block  has  been  run.  This 
is  acceptable  unless  the  experimenter  considers  a  change  in  the  system  over 
time.  A  system  change  can  be  overcome  by  dividing  the  basic  block  into  smaller 
blocks.  The  assumption  is  made  that  the  system  is  relatively  homogeneous 
within  each  block.  Techniques  for  the  construction  of  blocks  are  identical 
to  those  used  to  build  the  alias  set.  An  effect  is  selected,  and  the  effect 
equation  is  generated.  For  example,  consider  effect  AC.  The  value  of  the 
effect  equation  for  AC  equals  0  modulo  2  goes  into  one  block,  and  the  effect 
equation  for  AC  equals  1  modulo  2  goes  into  a  second  block.  This  causes  effect 
AC  to  be  no  longer  measurable,  i.e.,  the  experimenter  cannot  know  if  a  response 
is  due  to  the  interaction  AC  or  to  a  change  between  blocks. 

Blocking  procedures  are  not  included  in  this  program.  This  capability  will 
be  added  at  a  later  date.  The  inclusion  of  this  feature,  however,  requires  a 
trained,  experienced  user. 

Once  the  data  have  been  collected,  they  must  be  analyzed  to  identify  significant 
effects.  This  analysis  consists  of  an  analysis  of  variance  (ANOVA)  or  of  a 
regression  analysis.  Because  details  concerning  ANOVA  and  regression  analysis 
methods  may  be  found  in  any  statistical  analysis  text,  they  have  not  been 
included  here. 


REFINING  DESIGNS 

When  data  have  been  collected  and  analyzed  from  a  fractional  factorial  experi¬ 
ment,  the  experimenter  may  determine  that  he  wishes  to  further  examine  certain 
effects  or  interactions  that  were  confounded  in  the  original  design.  Finding 
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a  new  design  in  which  these  effects  are  separated  is  called  refining  the  design. 
This  is  accomplished  by  dividing  one  of  the  effects  to  be  separated  by  the 
other  to  yield  a  member  of  the  alias  set.  This  division  is  defined  as  a  sub¬ 
traction  of  corresponding  exponents  where  an  exponent  is  increased  by  P  when¬ 
ever  the  subtrahend  would  have  been  larger  than  the  minuend.  For  example,  if 
P  -  3, 

201/102  201  104 

-102  -102 
102 

The  member  of  the  power  set  that  was  used  to  generate  this  member  of  the  alias 
set  is  examined  for  non-zero  columns.  Removal  of  any  one  of  the  defining 
contrasts  represented  by  these  columns  results  in  separating  the  two  effects, 
(i.e.,  if  the  member  of  the  power  series  was  found  to  be  210,  removal  of  either 
the  first  or  the  second  defining  contrast  would  accomplish  the  desired  separa¬ 
tion). 

Removal  of  a  defining  contrast  results  in  doubling  the  total  number  of  trials 
in  a  two-level  experiment,  and  tripling  the  total  number  of  trials  in  a 
three-level  experiment,  although  the  first  portion  of  the  experiment  may  have 
already  been  completed  before  removal  of  the  defining  contrast.  This  is  the 
price  paid  for  reducing  the  confounding. 

IRREGULAR  FRACTIONAL  FACTORIAL  EXPERIMENTS 

The  generation  of  fractional  experiments  uses  a  1/PN  design,  i.e.,  a  1/8,  a 
1/27,  or  a  1/64  design.  Although  any  fraction  such  as  k/PN  may  be  constructed, 
these  designs  have  many  problems.  Consider  the  case  with  five  factors  at  two 
levels,  but  with  only  24  observation  vectors  available.  One  possibility  would 
be  a  3/4  design  based  on  using  a  1/2  and  1/4  replicate  design.  If  this  is 
used,  the  total  design  will  have  highly  correlated  estimates  that  could  lead 
to  extremely  difficult  tests  of  significance. 


Another  approach  would  be  to  use  a  1/2  replicate  and  a  1/2  replicate  of  the 
unused  portion  of  the  larger  design.  Because  of  confounding,  however,  this 
design  provides  less  information  to  the  experimenter  than  the  1/2  replicate 
alone.  For  these  reasons,  fractional  designs  other  than  a  1/pN  are  not 
advantageous. 

SCREENING  DESIGNS 

One  of  the  common  information  objectives  of  human  factors  engineering  research 
(and  indeed  of  many  experiments  in  general)  is  to  determine  the  factors  that 
produce  a  certain  result  and  the  relative  importance  of  these  factors. 

Before  a  formal  experiment  can  ever  be  conducted,  an  investigator  is  generally 
required  to  cull  the  list  of  possibly  hundreds  of  potential  factors  by  con¬ 
sidering  such  criteria  as: 

Information  gained  from  related  research 
Practical  constraints  of  time  and  money 
Customer  interest 
Rational  analysis. 

Once  the  least  interesting  factors  have  been  pared  from  the  list  of  potentials, 
fractional  factorial  designs  used  as  sequential  experiments  can  be  of  real 
value. 

The  term  sequential  design  is  generally  used  to  describe  experiments  in  which 
the  yield  or  response  on  any  unit  is  known  before  the  experimenter  treats  the 
next  unit.  When  an  experiment  is  sequential,  the  experimenter  can  stop  after 
every  observation  or  group  of  observations  and  examine  the  results  to  date 
before  deciding  how  or  whether  to  continue  the  experiment. 

The  term  screening  design  is  generally  used  to  describe  experiments  where  an 
Investigator  starts  with  a  relatively  large  number  of  factors,  and  by  performing 
a  small  number  of  trials,  (using  a  highly  fractionated  design)  can  determine 
that  some  of  the  factors  are  of  little  significance.  These  factors  can  then 


be  eliminated  or  screened  from  further  consideration,  and  another  experiment 
can  be  designed  from  the  remaining  factors.  Once  the  factors  that  are  of 
importance  relative  to  a  given  error  of  prediction  have  been  identified,  it 
may  be  necessary  to  perform  detailed  work  on  these  factors,  perhaps  using 
more  levels  per  factor,  or  creating  a  mixed  level  design,  or  using  a  central 
composite  design. 


RESPONSE  SURFACE  DESIGNS 

In  many  investigations,  the  final  goal  is  to  study  how  the  response  varies  in 
an  experimental  region  and  perhaps  to  determine  the  factor  combination  yielding 
an  optimum  response  (if  an  optimum  response  is  suspected  to  exist).  If  the  N 
significant  factors  are  all  quantitative  with  their  levels  denoted  Xi,  X2» 

...,  Xn  and  the  response  is  quantitative  with  its  level  denoted  Y,  then  Y  is 
a  function  0  of  the  Xi,  X2,  ...»  Xn;  i.e.,  Y  =  0  (Xj,  X2  ....  Xn).  The  function 
0  is  called  the  response  function  or  response  surface.  Then  the  final  goal 
of  the  investigation  is  to  determine  the  behavior  of  the  function  0  in  the 
experimental  region. 

APPROXIMATIONS  OF  RESPONSE  SURFACES  BY  POLYNOMIALS 
THE  RESPONSE  SURFACE 

Suppose  all  N  factors  and  the  response  are  quantitative  and  continuous.  Denote 
the  levels  of  the  factors  by  Xp  ....  X^  and  denote  the  level  of  the  response 

by  Y.  Then  Y  is  a  function  0  of  Xp  X ^ . X^  and  we  can  write  Y  =  0(Xp 

Xp  •••»  xn)’  The  function  0  is  called  the  response  function.  We  can  also 
Interpret  Y  *  0  (Xp  X^t  ....  XN)  as  the  equation  of  a  surface  in  N+l  dimensional 
space,  called  the  response  surface.  The  terms  response  surface  and  response 
function  will  be  used  Interchangeably. 

Note  that  we  have  restricted  the  concept  of  a  response  surface  to  the  case 
where  the  response  and  all  factors  are  quantitative.  If  only  some  of  the 
factors  are  quantitative,  say  the  first  K,  then  one  could  fix  the  levels  of 
the  qualitative  factors,  so  that  they  become  constants  Instead  of  factors. 

One  could  then  talk  about  the  response  function  Y  *  0  (Xp  Xp  ...XK).  Whether 
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or  not  consideration  of  this  restricted  response  function  is  worthwhile,  and 
if  so,  at  which  levels  the  qualitative  factors  should  be  fixed,  must  be  deter¬ 
mined  by  the  investigator. 

POLYNOMIAL  APPROXIMATIONS 

In  most  investigations  the  nature  of  the  response  surface  (i.e. ,  the  form  of 
the  response  function)  is  unknown,  so  a  goal  of  actually  determining  the  true 
response  function  is  unattainable.  Consequently,  we  will  be  satisfied  if  we 
can  find  an  approximating  function  such  that  the  value  of  the  approximating 
function,  in  the  experimental  region  under  investigation,  is  sufficiently 
close  to  the  observed  response  for  our  purposes. 

The  only  approximating  functions  we  will  consider  will  be  polynomials  in  the 
levels  of  the  factors.  Polynomials  are  relatively  easy  to  work  with,  and  in 
a  given  region  any  continuous  function  can  be  approximated  to  any  desired 
degree  of  accuracy  by  a  polynomial  of  sufficiently  high  degree. 

For  example,  suppose  an  investigation  involves  three  factors.  Then  some  of 
the  possible  polynomial  approximations  are  as  follows: 

1.  A  linear  approximation  is  a  polynomial  of  degree  one  and  is  of  the 
form: 

Y  »  Bq  +  81X1  +  82X2  +  B3X3 

2.  A  quadratic  approximation  is  a  polynomial  of  degree  two  and  is  of 
the  form: 


3.  A  cubic  approximation  is  a  polynomial  of  degree  three  apd  is  of  the 
form: 

Y  -  V  B1X1  *  B2X2  *  B3*3  *  B11X1  *  B22X2 


+  B33X3  +  B12X1X2  +  B13X1X3  +  B23X2X3 


+B1I1X1  +  B222X2  +  B333X3  +  B112X1  +  B122X1X2 


+  B113XjX3  +  Bi33xix3  +  B223^2  X3  +  B233X2X3  +  B123X1X2X3 


A  polynomial  of  degree  greater  than  three  is  a  straightforward  extension  of 
the  above  cases.  However,  such  polynomials  are  relatively  unlikely  to  be 
used  for  approximating  response  surfaces. 

Note  that  each  of  the  above  polynomials  is  a  complete  polynomial  in  that  it 
contains  all  possible  terms  of  degree  less  than  or  equal  to  the  degree  of  the 
polynomial.  Also,  in  the  above  polynomials  each  term  can  be  interpreted  as  a 
contribution  to  the  response  level  Y  due  to  a  certain  one-factor  effect  or  to 
a  factor  interaction.  For  instance,  in  the  quadratic  case 

Bo  is  the  base  level  of  the  response  (the  response  level  when  all  factors 
are  at  level  zero) 

BiXi  is  the  linear  effect  of  the  i-th  factor 
B^X?  is  the  quadratic  effect  of  the  i-th  factor 

BijXiXj  the  two"^actor  interaction  effect  of  the  i-th  and  j-th  factors. 

When  we  choose  the  degree  of  the  approximating  polynomial,  we  make  certain 
implicit  assumptions  about  the  significance  of  certain  effects.  If  we  choose 
a  linear  approximation,  we  are  assuming  that  all  two-factor  Interactions  and 
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all  quadratic  one-f actor  effects  are  not  significant;  If  we  choose  a  quadratic 
approximation,  we  are  assuming  that  all  three-factor  interactions  and  all 
cubic  one-factor  effects  are  not  significant.  If  these  implicit  assumptions 
are  Incorrect,  the  approximating  polynomial  is  likely  to  fit  the  observed 
responses  poorly. 

The  polynomial  degree  chosen  may  also  vary  with  the  purpose  of  the  approximation 
and  may  be  different  at  different  phases  of  a  sequential  design.  For  instance, 
in  an  investigation  whose  goal  is  to  determine  an  optimum  response  we  would 
normally  use  linear  approximations  at  each  step  where  we  use  the  method  of 
steepest  ascent  (see  Cochran  &  Cox,  1957)  but  then  go  to  a  quadratic  approxi¬ 
mation  at  the  point  where  the  method  of  steepest  ascent  finally  breaks  down. 

DATA  REQUIREMENTS 

Having  decided  what  degree  of  polynomial  approximation  to  use,  we  must  design 
an  experiment  that  will  yield  data  sufficient  to  allow  a  determination  of  the 
coefficients  of  the  polynomial.  In  particular,  the  following  restrictions 
apply. 

1.  The  number  of  levels  at  which  the  i-th  factor  occurs  must  be  at  least 
one  greater  than  the  hightest  power  of  Xi  in  the  polynomial. 

2.  The  total  number  of  distinct  factor  combinations  (experimental  trials) 
must  be  at  least  as  large  as  the  number  of  polynomial  coefficients 

to  be  determined. 

3.  The  design  of  the  experiment  should  not  allow  any  two  terms  in  the 
polynomial  to  have  their  corresponding  factor  combinations  aliased 
with  one  another. 


Even  these  three  conditions  do  not  guarantee  that  the  experimental  data  are 
sufficient  to  allow  determination  of  all  polynomial  coefficients.  However, 
an  appropriate  central  composite  design  (discussed  later)  will  always  be 
sufficient  to  determine  all  coefficients  of  the  desired  quadratic  polynomial. 


USE  OF  INCOMPLETE  POLYNOMIALS 

To  this  point  It  has  been  assumed  that  the  approximating  polynomial  Is  a  complete 
polynomial,  i.e.,  that  It  contains  all  possible  terms  of  degree  less  than  or 
equal  to  the  degree  of  the  polynomial.  This  need  not  be  the  case.  From  a 
complete  polynomial  we  could  omit  those  terms  corresponding  to  effects  that 
are  known  to  be  not  significant. 

For  example,  suppose  there  are  6  factors  A,B,C,D,E,  and  F  but  that  It  Is  known 
that  the  only  significant  Interactions  are  the  two-factor  Interactions  between 
A,B,  and  C.  Then  instead  of  the  complete  quadratic  polynomial,  which  contains 
28  terms,  one  could  use  the  following  as  an  approximating  polynomial: 

y*b+|bx+|bx2 

o  1*1  i  1  i=l  1i  i 

+  B  Xx  +  B  XX  +  B  XX 
12  1  2  13  1  3  23  2  3 


This  incomplete  polynomial  contains  only  16  terms;  twelve  two-factor  interaction 
terms  have  been  omitted.  The  possible  advantage  of  an  incomplete  polynomial 
is  that  one  may  be  able  to  generate  sufficient  data  (to  determine  the  poly¬ 
nomial  coefficients)  from  a  smaller  experiment  than  is  required  for  the  complete 
polynomial.  The  notation  P1^  where  P  is  the  number  of  levels,  N  is  the  number 
of  factors,  and  M  is  the  number  of  defining  contrasts  will  be  used  in  the 
following  examples  to  describe  the  factorial  case  under  consideration.  In 
the  above  example,  a  26-*  factorial  (e.g.,  with  I  *  ABCDEF)  would  be  required 

to  determine  all  two-factor  interactions  in  the  complete  polynomial,  but  a 
6-2 

2  factorial  (e.g.,  with  I  *  ABCD  *  ABEF)  would  allow  determination  of  all 
necessary  two-factor  interactions  in  the  complete  polynomial. 

THE  CENTRAL  COMPOSITE  DESIGN 

The  central  composite  design  is  specifically  intended  to  allow  determination 
of  a  quadratic  approximation  of  the  response  surface.  It  is  a  composite  or 
combination  of  a  full  or  fractional  two-level  factorial  design  and  some  addi¬ 
tional  experimental  points  selected  in  a  particular  manner  so  as  to  allow  a 
good  determination  of  the  quadratic  one  factor  effects.  Thus  the  central 
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composite  design  is  often  appropriate  when  one  suspects  that  the  relationship 
between  the  response  and  the  level  of  a  factor  Is  non-linear.  In  addition, 
the  central  composite  design  should  give  a  good  estimate  of  the  response  mean 
and  provide  an  estimate  of  the  precision  of  the  mean. 

The  central  composite  design  is  often  especially  suitable  in  a  sequential 
design  process.  It  is  sometimes  a  less  costly  alternative  to  three  or  five- 
level  factorial  designs.  Some  examples  of  situations  where  the  central  com¬ 
posite  design  might  be  used  are  as  follows: 

1.  One  has  already  run  a  full  or  fractional  factorial  experiment  and 
now  wants  information  about  possible  non-linearity  and  the  shape  of 
the  response  surface,  plus  a  better  estimate  of  the  mean,  with  a 
minimum  number  of  additional  trials. 

2.  An  investigation  involves  a  small  number  of  continuous  quantitative 
factors  and  one  wants  as  much  information  as  possible  quickly  and  at 
low  cost. 

3.  One  has  already  run  a  full  or  fractional  two-level  experiment  and 
wants  to  expand  the  experimental  region  at  low  cost. 

DEFINITION  OF  THE  CENTRAL  COMPOSITE  DESIGN 

An  N-factor  central  composite  design  consists  of  three  components. 

1.  A  full  or  1/2m  replicate  of  a  2N  factorial  design,  where  for  each 
factor  the  two  coded  levels  are  -1  and  1. 

2.  2N  star  or  axial  points.  For  each  factor  there  are  two  corresponding 
axial  points;  the  given  factor  has  coded  level  -a  at  one  point  and  +a 
at  the  other,  whereas  all  other  factors  have  coded  level  zero  at 
both  points. 

3.  The  center  point,  where  all  N  factors  have  coded  level  zero. 
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Figure  2.  Central  Composite  Design 

For  example,  a  three-factor  central  composite  design  would  be  as 
follows,  where  the  experimental  point  with  first  factor  at  coded 
level  Xj,  second  factor  at  coded  level  X2,  and  third  factor  at  coded 
level  X3  is  represented  by  the  vector  (X^,  X2,  X3). 

1.  A  full  23  factorial:  (-1,-1, -1),  (-1,-1, 1),  (-1.1.-1),  (-1,1,1). 

(1,-1,-1),  (l.-l.-l),  (1,1, -1),  (1,1,1) 

2.  6  axial  points:  (-<*,0,0),  (<*,0,0),  (0,-a  ,0),  (0,a  c). 

(0,0, -a),  (0,0, a) 

3.  The  center  point:  (0,0,0) 

CODED  VS.  REAL  WORLD  LEVELS 

In  the  central  composite  design  the  coded  or  formal  levels  of  each  factor  are 
-1,  0,  1,  and  a  .  The  real  world  levels  of  a  factor  (i.e.,  the  true 
quantitative  levels  of  the  factor  that  correspond  to  the  coded  levels)  must 
be  determined  by  the  researcher.  In  determining  the  real  world  experimental 
range  of  levels  for  a  factor,  whether  for  a  central  composite  design  or  some 
other  design,  the  following  should  be  considered. 

-55- 


1.  If  the  chosen  range  Is  too  small,  the  researcher  may  erroneously  conclude 
that  the  factor  is  not  significant  (e.g.,  in  a  pilot  study  to  determine 
significant  factors),  that  the  one-factor  effect  of  that  factor  is  linear, 
or  that  the  factor  does  not  interact  with  other  factors. 

2.  If  the  chosen  range  is  too  large,  effects  of  order  higher  than  the  degree 
of  the  approximating  polynomial  may  become  significant.  This  could  result 
in  a  poor  fit  between  the  approximating  polynomial  and  the  observed  data. 

Having  decided  upon  the  real  world  experimental  range  to  be  used  for  a  parti¬ 
cular  factor,  we  can  use  the  following  linear  transformation  to  determine  the 
real  world  level  corresponding  to  any  formal  level. 

(rU-rL)  f+  (VrL) 

r  — r~ 

Here  r  is  the  real  world  level,  f  is  the  formal  or  coded  level,  and  rLand  ry 
are  the  lower  and  upper  value  in  the  chosen  real  world  range. 

If  a  full  or  fractional  2  level  factorial  experiment  has  already  been  completed, 
we  can  use  the  following  linear  transformation  to  determine  the  real  world 
level  corresponding  to  any  formal  level. 

<r.rr-i>  f  +  <r*rr-i> 

- - 2 -  - 2 - 

Here  r  is  the  real  world  level,  f  is  the  formal  or  coded  level,  and  r_j  and 
r+j  are  the  real  world  levels  rf  the  previously  defined  2  level  factorial 
experiment. 

In  certain  Instances  one  might  replace  the  real  world  levels  of  a  factor  by  a 
function  of  the  levels.  For  Instance,  If  one  Is  using  the  real  world  range 
.001  to  .1  but  wishes  to  consider  .01  as  the  midpoint  of  the  range,  then  one 
could  replace  the  raw  values  by  their  logarithms.  This  would  give  r^  *  log 
(.001)  ■  -3,  ry  ■  log  (.1)  »  -1,  and  log  (.01)  ■  -2  is  mldwey  between  rL  and 

nr 


The  linear  transformation  would  then  be: 


The  5  levels  of  that  factor  occurring  in  the  central  composite  design  would 
be: 


coded  or  formal  level 

-a 

-1 

0 

1 

a 

real  world  level  (log) 

-3 

-2-1/a 

-  2 

-2+1/a 

-1 

real  world  raw  value 

.001 

10-2-1/a 

.01 

10-2+1/a 

.1 

CHOICE  OF  THE  LEVEL  2. 

A  rotatable  design  is  one  that  leaves  the  variance  of  the  estimated  response 
unchanged  when  the  design  is  rotated  about  the  center.  This  means  that  the 
variance  of  the  estimated  response  is  the  same  at  all  points  equidistant  from 
the  center  (0,0,  ...,0)  of  the  design.  Rotatable  designs  are  desirable  in 
situations  where  the  researcher  has  no  advance  knowledge  of  the  response  surface 
or  how  it  is  oriented  relative  to  the  factor  axes  and  thus  has  no  knowledge 
of  how  the  variance  of  the  estimated  response  will  vary  along  the  surface. 

Box  and  Hunter  (1957)  have  shown  that  if  the  factorial  part  of  the  central 
composite  design  is  a  2N~M  factorial  in  which  one-factor  effects  and  two- 
factor  Interactions  are  aliased  only  with  higher  order  effects,  then 
choosing  * *2  (N-M)/4  will  make  the  design  rotatable.  Although  rotatability 
is  not  critical,  unless  we  have  a  reason  for  doing  otherwise  we  would  normally 
place  all  2N  axial  points  at  the  distance  a=2(N-M)/4  from  the  center  point  so 
that  the  central  composite  design  Is  rotatable. 

In  certain  situations,  such  as  in  a  sequential  design  process  where  a  1/2** 
fractionation  resulted  from  a  prior  experiment,  there  may  be  one  or  more 
factors  for  which  the  levels  ^(N-**)/*  are  not  feasible.  In  such  situations 
we  might  choose  a  value  of  o  different  from  2(N-M)/4.  Alternatively,  the 
axial  points  for  those  factors  only  could  be  chosen  at  a  distance  other  than  a 
from  the  center;  In  fact  the  two  axial  points  for  a  factor  could  be  at  unequal 
distances  from  the  center  point. 
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The  purpose  of  each  pair  of  axial  points  is  to  increase  the  precision  of  the 
estimate  of  the  corresponding  quadratic  term  B^x^  Increasing  the  distances 
of  these  axial  points  from  the  center  will  decrease  the  variance  of  this 
estimated  one-factor  quadratic  effect  but  will  also  Increase  its  correlation 
with  other  such  effects  and  will  Increase  the  danger  of  bias  from  higher  order 
effects.  On  the  other  hand.  If  these  axial  points  are  within  or  very  near 
the  range  from  -1  to  1  then  they  may  not  significantly  increase  the  precision 
of  the  estimate  of  the  quadratic  effect  B^X^. 

USE  OF  MULTIPLE  OBSERVATIONS  AT  THE  CENTER  POINT 

Using  multiple  regression  techniques  on  the  experimental  data  resulting  from 
the  central  composite  design  or  some  other  appropriate  design,  we  can  derive 
a  polynomial  least  squares  approximation  to  the  response  surface.  From  this 
process  we  would  also  like  estimates  of  the  lack  of  fit  and  of  the  experimental 
error. 

1.  The  lack  of  fit  estimate  should  Indicate  the  significance  of  the 
totality  of  all  effects  without  corresponding  terms  in  the  polynomial. 
If  the  approximation  is  a  complete  quadratic  polynomial  these  would 

be  the  effects  represented  by  terms  of  degree  3  or  greater;  e.g., 

Bi1ix3i*  BiijXi2Xj’  B1jkX1XjXk’  etc* 

2.  The  experimental  error  estimate  is  just  an  estimate  of  the  experimental 
error  variance,  i.e.,  of  the  standard  error  of  the  estimated  response. 

In  the  central  composite  design  we  can  provide  for  an  estimate  of  the  experi¬ 
mental  error  by  repeating  observations  at  the  center  point.  If  there  are  n0 
replications  of  the  center  point,  they  provide  n0  -1  degrees  of  freedom  for 
estimating  the  experimental  error.  Box  and  Hunter  (1957)  determined  values 
of  n0  for  which  the  variance  of  the  estimated  response  is  approximately  the 
same  at  the  center  and  at  unity  distance  from  the  center  of  a  rotatable  central 
composite  design.  In  this  case  the  standard  error  Is  roughly  the  same  at  all 
points  within  the  sphere  of  radius  one  and  can  be  approximated  by  the  standard 
error  at  the  center  point;  the  graph  in  Box  and  Hunter  indicates  that  the 


standard  error  Increases  fairly  rapidly  outside  the  sphere  of  radius  one. 

From  Box  and  Hunter's  results  it  follows  that  the  formula  for  such  a  value  of 

no  is 

n  -  (2N-M  +4+4  2(N_M/2)  (  N  +  3  +  9N2  +  14N-7  )  _2N-M_2N 

0  4N  +  8 

Table  25  qives  such  values  of  n  (rounded  to  the  nearest  integer)  for  rotatabl 
3  0 

central  composite  designs. 

Table  25.  Replicates  of  Center  Point  for  Nearly  Uniform  Variance. 


N 

M-0 

M-1 

M  -  2 

M-3 

2 

5 

3 

8 

4 

7 

5 

10 

6 

6 

15 

9 

7 

21 

14 

8 

28 

20 

13 

9 

37 

25 

16 

10 

43 

38 

29 

18 

After  deriving  an  approximate  polynomial,  one  can  do  an  analysis  of  variance. 
By  partitioning  the  total  sum  of  squares  into  a  number  of  parts,  each  the 
contribution  due  to  a  source  of  interest,  one  can  get  a  lack  of  fit  estimate. 
For  instance,  for  a  quadratic  approximation  resulting  from  a  central  composite 
design  one  could  partition  the  sum  of  squares  into  four  parts: 

(a)  sum  of  squares  due  to  first  order  terms 

(b)  sum  of  squares  due  to  second  order  terms 

(c)  sum  of  squares  due  to  experimental  error  (from  the  n0  replications 

of  the  center  point) 

(d)  sum  of  squares  due  to  lack  of  fit. 


The  sum  of  squares  in  (d)  is  found  by  subtracting  from  the  total  sum  of  squares 
the  sum  ot  squares  in  (a),  (b)  and  (c).  By  comparing  the  mean  squares  for 
the  various  parts  in  the  partition,  one  can  determine  the  relative  significance 
of  each  part  of  the  partition. 

RESTRICTIONS  ON  A  CENTRAL  COMPOSITE  DESIGN 

The  following  comments  are  appropriate  to  a  discussion  of  the  restrictions 
which  must  be  placed  on  a  central  composite  design  in  order  to  allow  determina¬ 
tion  of  a  quadratic  approximation  of  a  response  surface. 

1.  In  that  part  of  the  central  composite  design  consisting  only  of  the 
axial  and  center  points,  each  factor  must  appear  at  three  separate 
levels  -a  ,  0,  and  a  ,  with  the  levels  of  all  other  factors  fixed  at 
0.  Thus  the  basic  level  Bo.  the  linear  one-factor  terms  B^,  and 
the  quadratic  one-factor  terms  B^X?  could  be  estimated  from  these 
points  alone. 

2.  The  two-factor  interaction  terms  B^X^Xj  must  be  estimated  from  the 
factorial  part  of  the  central  composite  design,  since  in  the  center 
and  axial  points  portion  of  the  central  composite  design  only  one 
factor  at  a  time  is  being  varied. 

From  these  two  comments  one  can  see  that  when  using  a  central  composite  design 
to  fit  a  quadratic  polynomial  to  a  response  surface,  the  basic  restriction  on 
the  central  composite  design  is  imposed  by  the  requirement  that  the  factorial 
part  of  the  central  composite  design  allow  estimation  of  all  two-factor  inter¬ 
action  terms  in  the  polynomial.  In  particular,  when  fitting  a  complete  qua¬ 
dratic  polynomial  this  requirement  is  that  no  two-factor  effect  be  aliased 
with  I  or  any  other  two-factor  effect.  In  practice,  we  strengthen  this  require¬ 
ment  to  "no  one-factor  effect  or  two-factor  interaction  can  be  aliased  with 
I,  a  one-factor  effect,  or  a  two-factor  interaction." 

When  fitting  an  incomplete  quadratic  polynomial  this  restriction  can  be  relaxed. 
Then  we  usually  require  that  each  of  the  main  effects  and  two-factor  interaction 
effects  with  a  corresponding  term  in  the  polynomial  not  be  aliased  with  another 
of  these  effects. 
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To  have  one-factor  effects  and  two-factor  Interactions  aliased  only  with  higher 
order  effects  It  Is  necessary  and  sufficient  that  the  non-I  terms  of  the  total 
alias  set  all  Involve  at  least  five  factors.  For  a  given  number  of  factors. 
Table  26  gives  the  smallest  possible  fractional  factorial  with  this  property. 


Table  26.  Minimum  Fractionation  Confounding  Only  Higher  Order  Effects 


NUMBER  N  OF 
FACTORS 

MINIMUM  FRACTIONATION 

NUMBER  OF  OBSERVATION 
VECTORS  IN  THE  FRACTIONATION 

2 

FULL 

4 

3 

FULL 

8 

4 

FULL 

16 

5 

1/2 

16 

6 

1/2 

32 

7 

1/2 

64 

8 

1/4 

64 

9 

1/4 

128 

10 

1/8 

128 

11 

1/16 

128 

12 

1/16 

256 

13 

1/32 

2S6 

14 

1/64 

2S6 

IS 

1/128 

256 

16 

1/128 

512 

17 

1/256 

512 

As  can  be  seen  from  the  above  table,  when  six  or  more  factors  are  involved 
the  central  composite  design  requires  a  fairly  large  number  of  factor  combi¬ 
nations  even  for  a  minimum  fractional  factorial.  Thus,  when  feasible,  it  may 
be  worthwhile  to  use  an  Incomplete  quadratic  polynomial.  For  instance.  If 
the  only  significant  Interactions  are  two-factor  Interactions  among  just  four 
of  the  factors,  then  a  16  unit  fractional  factorial  will  suffice  for  6,  7,  or 
8  factors  and  a  32  unit  fractional  factorial  will  suffice  for  9  or  10  factors. 
Predefined  Designs  2.6.16,  2.7.16,  2.8.16,  and  2.9.32  (see  section  15,  Prede¬ 
fined  Designs)  are  examples  of  such  fractional  factorials  if  the  only  signifi¬ 
cant  Interactions  are  taken  to  be  two-factor  Interactions  among  A,C,D,  and  E. 
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COMPARISON  WITH  THE  THREE-LEVEL  FACTORIAL 

The  central  composite  design  is  specifically  designed  to  allow  a  quadratic 
approximation  of  a  response  surface.  Other  designs  can  also  be  used  for  this 
purpose.  The  most  obvious  alternate  design  is  the  three-level  factorial. 

For  example,  if  we  want  a  complete  quadratic  approximation  of  a  five-factor 
response  surface,  then  we  could  either  use  a  central  composite  design  involving 
a  2^-1  factorial  or  use  a  35-1  factorial.  The  central  composite  design  will 
often  have  a  number  of  advantages  over  the  three  level  factorial. 

1.  The  central  composite  design  is  often  more  economical  than  alternate 
designs.  In  the  above  example  the  central  composite  design  requires 
only  27  points  whereas  the  35-1  design  requires  81  points,  where 
neither  count  includes  multiple  replicates  of  the  center  point. 

2.  The  central  composite  design  is  often  appropriate  in  a  sequential 
design  process.  If  one  has  already  run  a  2N-M  factorial  experiment 
from  which  one  has  determined  the  desirability  of  finding  a  quadratic 
approximation  of  the  response  surface,  then  it  may  be  sufficient  to 
collect  additional  observations  on  the  axial  and  central  points  to 
complete  the  central  composite  design. 

3.  In  the  central  composite  design  every  factor  appears  at  five  levels 
whereas  in  the  3N  factorial  every  factor  appears  at  only  three  levels. 
Thus  the  central  composite  design  should  give  better  relative  precision 
of  the  one-factor  quadratic  terms  B^X?. 

If  it  turns  out  that  a  quadratic  approximation  yields  a  poor  fit,  then  the  3- 
level  factorial  may  be  more  advantageous.  A  complete  3^  factorial  allows 
determination  of  third  degree  terms  with  each  factor  exponent  2,  whereas 
the  central  composite  design  involving  a  complete  2^  factorial  allows  deter¬ 
mination  of  third  and  fourth  degree  one-factor  terms  and  third  degree  inter¬ 
action  terms  with  all  factor  exponents  <_  1.  Thus  if  we  want  to  go  to  a  cubic 
approximation  without  additional  experimental  points,  whether  or  not  the  terms 
®1 1 1X?  are  raore  s’9ni^icant  than  the  terms  B^jX^Xj  determines  whether  or  not 
the  central  composite  design  allows  a  better  fit  than  the  3N  factorial.  In 
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any  case,  as  N  increases,  the  3N  factorial  becomes  much  more  expensive  than 
the  central  composite  design. 

DATA  ANALYSIS 

Once  the  experimental  data  have  been  collected  according  to  the  central  com¬ 
posite  design,  the  data  must  be  analyzed.  The  first  step  in  the  analysis 
process  is  to  use  multiple  regression  techniques  to  derive  the  polynomial  (of 
the  chosen  form)  which  provides  a  least  squares  best  fit  to  the  experimental 
data;  that  is,  the  polynomial  which  minimizes  the  sum  of  the  squares  of  the 
differences  between  the  observed  response  level  and  the  response  level  predicted 
by  the  polynomial.  The  details  of  this  derivation  are  documented  in  many  of 
the  references  and  in  most  statistics  texts  and  are  not  presented  here.  From 
this  derivation  process  we  can  also  get  estimates  of  a2  (the  variance  of  the 
estimated  response)  and  of  the  variances  and  covariances  of  the  estimates  of 
the  coefficients  of  the  derived  polynomial. 

The  second  step  in  the  analysis  process  is  an  analysis  of  variance.  Here  we 
tabulate  the  degrees  of  freedom,  the  sum  of  squares,  and  the  mean  square  for 
each  part  of  the  partition  of  sum  of  squares.  A  comparison  of  the  mean  squares 
indicates  the  relative  significance  of  each  part.  In  particular,  a  mean  square 
corresponding  to  lack  of  fit  that  is  substantially  larger  than  the  mean  square 
corresponding  to  experimental  error  indicates  that  the  derived  polynomial 
does  not  fit  the  true  response  surface  very  well. 

If  one  is  satisfied  that  the  derived  polynomial  provides  an  adequate  fit, 
then  there  are  several  additional  analysis  steps  one  might  consider. 

1.  One  could  try  to  find  a  stationary  point  of  the  quadratic  surface; 
i.e.,  a  point  where  the  partial  derivatives  of  the  polynomial  with 
respect  to  the  factor  levels  are  all  zero. 

2.  If  one  does  find  a  stationary  point,  one  could  perform  a  translation 
of  axes  and  a  rotation  of  axes  to  transform  the  quadratic  function 

to  its  canonical  form  Y  *  To  +  Ylz^  +  Y2Z£  +  ...  +  YN^*  *n 
canonical  form  the  origin  is  at  the  stationary  point  and  the  principal 


axes  of  the  quadratic  surface  are  also  coordinate  axes,  so  it  is 
relatively  easy  to  determine  the  shape  of  the  surface. 

3.  One  can  determine  whether  the  stationary  point  is  a  maximum  point  or 
a  saddle  point. 

4.  If  the  stationary  point  is  a  saddle  point,  one  can  determine  the 
directions  of  most  promise  for  a  further  search  for  an  optimum  point. 

These  steps  are  appropriate  mainly  in  those  situations  where  one  might  suspect 
the  existence  of  an  optimum  response.  In  particular  these  steps  depend  on 
the  existence  of  a  stationary  point,  which  in  many  situations  may  not  exist. 

In  any  analysis  of  the  derived  polynomial,  it  should  be  kept  in  mind  that 
even  if  the  polynomial  provides  a  good  fit  the  polynomial  should  be  considered 
to  be  a  good  approximation  only  within  the  region  bounded  by  the  experimental 
ranges  of  the  factors.  If  one  extrapolates  beyond  that  region  then  any  con¬ 
clusions  drawn  may  be  suspect.  For  instance,  if  the  analysis  of  the  quadratic 
function  indicates  a  stationary  point  is  a  maximum  point,  but  the  stationary 
point  is  outside  the  experimental  region,  then  the  stationary  point  may  not 
be  very  close  to  a  real  maximum.  In  this  situation  it  might  be  best  to  do 
further  investigation  by  moving  toward  this  calculated  maximum  point  and  running 
additional  observations. 


MIXED  LEVEL  DESIGNS 

COMBINED  QUALITATIVE  AND  QUANTITATIVE  FACTORS 

The  simplest  form  of  combined  level  design  involves  an  experiment  which  includes 
both  qualitative  and  quantitative  factors  with  all  factors  involving  the  same 
number  of  levels.  As  an  example,  consider  an  experiment  involving  five  factors. 
Factors  A,B,  and  C  are  quantitative  and  D  and  E  are  qualitative.  A  two  level 
design  is  to  be  used.  This  may  be  expressed  as  a  2322  design.  Fractionation 
should  not  be  applied  to  qualitative  variables,  so  only  the  23  portion  of 
this  design  can  be  fractionated.  Possible  fractionations  for  this  design  are 
as  shown  in  Table  27. 
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Table  27.  5  Factor,  2  Level,  Mixed  Qualitative  and  Quantitative  Designs 


FRACTIONATION 

NO.  OF  TRIALS 

DEFINING  CONTRASTS 

ALIAS  SET 

NONE 

32 

NONE 

NONE 

1/2 

16 

1- ABC 

ABC 

1/4 

8 

1  -  AB,  1  -  BC 

AB.BC.AC 

As  another  example,  consider  the  same  five  factor  problem  in  which  a  three 
level  design  is  to  be  used.  This  is  shown  in  Table  28. 


Table  28.  5  Factor,  3  Level,  Mixed  Qualitative  and  Quantitative  Designs 


FRACTIONATION 

NO.  OF  TRIALS 

DEFINING  CONTRASTS 

ALIAS  SET 

NONE 

243 

NONE 

NONE 

1/3 

81 

1- ABC 

ABC.A2B2C2 

1/9 

27 

1  -  AB,  1  -  BC 

AB,A282,BC,B2C2 

AC,AC2.A2C,A2BC2 

Thus  any  grouping  of  factors  at  a  given  level  which  consists  of  both  qualitative 
and  quantitative  factors  should  be  expressed  as 

pQpR  where  P  =  no  of  levels 

Q  =  no  of  quantitative  factors 
R  =  no  of  qualitative  factors 

Fractionation  should  only  be  applied  to  the  PQ  portion  of  this  expression. 

2*3k  DESIGNS 

If  an  experiment  involves  only  quantitative  factors,  some  at  one  set  of  levels 
(two  levels  for  example)  and  the  other  at  a  different  number  of  levels  (e.g., 
three  levels)  it  requires  a  mixed  level  design.  A  mixed  level  design  of  this 
type  is  most  simply  approached  by  considering  each  portion  of  the  design 
separately,  assigning  defining  contrasts  for  each  portion  of  the  design,  and 
performing  an  optimum  fractionation  for  each  portion  of  the  design  followed 
by  a  cross  multiplication  of  the  resultants  for  each  portion  of  the  design. 
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As  an  example,  a  2K3L  design  could  be  defined  for  a  1/2  fraction  by  defining 
the  basic  block  for  a  1/2  fraction  of  the  2*  which  would  be  assembled  with 
the  complete  3>-  to  arrive  at  the  design. 

If  K  =  3  and  L  =  2,  the  resultant  component  would  be  as  follows: 


2  Level 

3  Level 

Design 

000 

00 

00000 

01100 

10100 

11000 

Oil 

01 

00001 

01101 

10101 

11001 

101 

02 

00002 

01102 

10102 

11002 

110 

10 

00010 

OHIO 

10110 

11010 

11 

00011 

01111 

10111 

11011 

12 

00012 

01112 

10112 

11012 

20 

00020 

01120 

10120 

11020 

21 

00021 

01120 

10121 

11021 

22 

00022 

01122 

10122 

11022 

Upon  examining  the  resulting  design,  we  find  that  the  levels  are  not  "mixed" 
as  well  as  they  might  be.  As  an  example,  when  the  first  two  (2)  level  factors 
are  at  the  same  level  (either  both  low  or  both  high),  although  the  three  level 
term  is  exercised  at  all  levels,  the  third  2  level  term  is  always  at  its  low 
level. 

An  approach  to  improving  the  "mixing"  of  levels  in  the  design  is  to  perform  a 
fractionation  upon  all  portions  of  the  design  and  assemble  the  resulting  fractions 
to  arrive  at  the  desired  fraction.  In  our  sample  case  this  would  be  done  as 
fol lows: 

If  a  1/2  fraction  is  desired,  the  two  level  portion  is  divided  into  two  parts 
Sj  and  S2*  is  the  basic  block  and  S2  is  the  remaining  block.  The  three 
level  term  is  divided  into  Sj,  S^,  and  where  =  0  (mod  3),  =  1  (mod 

3)  and  =  2  (mod  3).  The  treatment  combinations  are  then: 
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2  Level  3  Level 


h 

fl 

fi 

000 

001 

00 

01 

02 

Oil 

010 

12 

10 

n 

101 

100 

21 

22 

20 

110 

111 

The  experimental  plan  can  then  be  formulated  as: 

5>1^1  +  S2S3  +  ^1^3  or  fractionally  =  +  + 

The  resulting  design  is  now: 


00000 

00101 
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11122 
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This  design  results  in  a  better  mixing  than  the  original  design.  A  symmetrical 
design,  in  which  each  fraction  for  a  portion  of  the  design  is  used  the  same 
number  of  times  as  every  other  fraction  for  that  portion  of  the  experimental 
design,  would  provide  the  optimum  level  of  mixing.  However,  this  cannot  be 
achieved  except  in  a  few  cases. 


The  first  step  In  the  process  of  formulating  a  mixed  level  design  Is  to  determine 
the  number  of  components  in  the  experimental  plan.  This  will  be  illustrated 
for  the  2*3l  design,  1/2  fractionation. 


The  experimental  plan  will  consist  of: 


1/2  =  G  where  G  =  3P  2M'1 

*■  i  and  P  *  L 
M  =<  K 


If  K  *  3,  L  *  2  (2332),  the  possibilities  are: 


1/2  =  3  1-3  =  6  \  ^  =  12  |  .  I 


Experimental  plans  corresponding  to  these  are: 


S1S1+S2S2+S1S3 


or 


S  jS  j+$2S 2+S  3S  3+S4S |+S  2S3 


or 


SlSl+S2S2+S3S3+S4Si+S5S2+S6S3+S7Si+S8S2 


+SlS3+S2Si+S3S2+S4S3 


For  simplicity,  the  3  element  plan  would  be  selected  since  the  more  complex 
plans  do  not  offer  significant  advantages. 

PREDEFINED  DESIGNS 


An  experimenter  frequently  requires  a  design  for  which  he  is  unable  to  find 
the  appropriate  aliasing.  This  section  includes  a  set  of  predefined  designs 
that  allow  for  all  main  effects  to  be  measurable.  Main  effects  are  aliased 
with  only  high-order  interactions.  Also,  most  two-factor  interactions  are 
measurable. 
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To  aid  the  user,  the  different  experimental  designs  are  Identified  by  the 
notation  L.F.S.,  where  L  Is  the  number  of  levels  per  factor,  2  or  3;  F  Is  the 
number  of  factors;  and  S  Is  the  number  of  observation  vectors  In  the  fractional 
design  (e.g.,  2.4.8  3  2  levels,  4  factors,  and  8  units),  the  sources  of  these 
predefined  designs  are  C&C  (Cochran  and  Cox,  1|957 )  NBS  #48  and  NBS  #54.  Some 
predefined  designs  were  developed  as  a  result  of  this  study. 


Design  2.4.8 

Deslqn  2.6.8 

2*  factorial  In  8  units 

2®  factorial  in 

8  units 

1/2  replicate 

1/8  replicate 

I  3  ABCD 

I  =  ACE  3  ADF  3 

BCF 

C&C,  p.  276 

C&C,  p.  278 

Deslqn  2.5.8 

Design  2.6.16 

2^  factorial  In  8  units 

2®  factorial  in 

16  units 

1/4  replicate 

1/4  replicate 

I  3  ABE  3  CDE 

I  3  ABCE  3  ABDF 

C&C,  p.  277 

C&C,  p.  278 

Deslqn  2.5.15 

Design  2.6.32 

c 

25  factorial  in  16  units 

2°  factorial  in 

32  units 

1/2  replicate 

1/2  replicate 

I  3  ABCDE 

I  =  ABCDEF 

C&C,  p.  277 

C&C,  p.  279 

Design  2.7.8 

Deslqn  2.8.32 

2?  factorial  in  8  units 

2®factorial  In  : 

32  units 

1/16  replicate 

1/8  replicate 

I  3  ABG  =  ACE  =  ADF  3  BCF 

I  3  BCDH  3  BDFG 

3  ABCEF 

C&C,  p.  280 

C&C,  p.  286 

Design  2.7.26 

Design  2.8.64 

27  factorial  In  16  units 

2®  factorial  In 

64  units 

1/8  replicate 

1/4  replicate 

I  3  ABCD  =  ABEF  3  ACEG 

I  3  ABCEG  3  ABDFH 

C&C,  p.  280 

C&C,  p.  287 
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Design  2.7.32 

2 7  factorial  in  32  units 
1/4  replicate 

1  =  ABODE  =  ABCF6 
C&C,  p.  281 

Design  2.7.64 

2  7  factorial  in  64  units 
1/2  replicate 

I  =  ABCDEFG 
C&C,  p.  283 

Design  2.8.16 

28  factorial  in  16  units 
1/16  replicate 

I  =  ABCD  *  ABEF  *  ABGH  *  ACEH 
C&C,  p.  285 

Design  2.9.128 
2^  factorial  in  128  units 
1/4  replicr.te 
I  =  ABCEGo  *  ABDFHJ 
NBS  #48,  p.  24 

Design  2.9«256 

29  factorial  in  256  units 
1/2  replicate 

I  *  ABDEFGHJ 
NBS  #48,  p.  17 


Design  2.8.128 

28  factorial  in  128  units 
1/2  replicate 

I  =  ABCDEFGH 
C&C,  p.  288 

Design  2.9.32 

29  factorial  in  32  units 
1/16  replicate 

I  =  ABCD  =  ABEF  =  BCEG  =  EFGHJ 
NBS  #48,  p.  43 

Design  2.9.64 
29  factorial  in  64  units 
1/8  replicate 
I  «  ABEGHJ  =  ACFGO  =  ABCD 
NBS  #48,  p.  33 

Design  2.10.512 
210  factorial  in  512  units 
1/2  replicate 
I  =  ABCDEFGHJK 


Design  3.3.9 
33  factorial  in  9  units 
1/3  replicate 
I  =  ABC 

Developed  Design 


Design  2.10.64  Design  3.4.9 

210  factorial  in  64  units  3^  factorial  in  9  units 

1/16  replicate  1/9  replicate 

I  «  ABCDJK  *  ABEFJ  *  BCEGJK  =  ABCDEFGH  I  *  ABC  *  BC2d 
NBS  #48,  p.  44  Developed  Design 
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Design  2.10.128 

210  factorial  in  128  units 

1/8  replicate 

I  -  A8EGHJ  =  ACFGJK  =  ABCDK 
NBS  #48,  p.  36 

Design  2.10.256 
210  factorial  in  256  units 
1/4  replicate 
I  =  ABCDEFG  *  ABCOHJK 
N8S  #48,  p.  29 

Design  3.5.81 

35  factorial  in  81  units 
1/3  replicate 

I  =  ABODE 
NBS  #54,  p.  11 

Design  3.6.27 

36  factorial  in  27  units 
1/27  replicate 

I  =  ABCDEF2  =  BC2EF2  =  ABCE 
Developed  Design 

Design  3.6.81 
36  factorial  in  81  units 
1/9  replicate 
I  =  ACDE  =  BC2DE2F 
NBS  #54,  p.  19 


Design  3.4.27 

3^  factorial  in  27  units 

1/3  replicate 

I  -  ABCD 

NBS  #54,  p.  11 

Design  3.5.27 
35  factorial  in  27  units 
1/9  replicate 
I  =  ABODE  =  ABC2 
Developed  Design 

Design  3.7.243 

3 7  factorial  in  243  units 
1/9  replicate 

I  =  ABODE  =  CD2eF2g2 
NBS  #54,  p.  20 

Design  3.7.729 
3?  factorial  in  729  units 
1/3  replicate 
I  =  AB2CDE2FG 
NBS  #54,  p.  17 

Design  3.8.81 

38  factorial  in  81  units 
1/81  replicate 

I  =  BCDEFG  *  ACDE2F2H  =  AC2d2fG 
BC2F2C 

Developed  Design 
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Design  3.6.243 
3$  factorial  In  243  units 
1/3  replicate 
I  »  AB2CDE2F 
N6S  #54,  p.  14 

Design  3.7.27 
37  factorial  In  27  units 
1/81  replicate 
I  *  ACDEF2  =  BC2EF2G  * 

ABC  E  G2  =  AB2CD2E2F2G2 
Developed  Design 

Design  3.7.81 
37  factorial  in  81  units 
1/27  replicate 

I  «  ACDEF2G  *  BC2EF2G  *  ABCEG2 
NBS  #54,  p.  23 


Design  3.9.243 
39  factorial  in  243  units 
1/81  replicate 
I  =  BCDEFG  =  ACDE2F2H  = 
ABD2e2FJ  =  ABC2EF2 
NBS  #54,  p.  31 

Design  3.10.243 
310  factorial  in  243  units 
1/243  replicate 
I  =  BCDEFG  =  AC0E2F2H  * 
ABD2E2FJ  «  ABC2EF2  * 
AB2C2DFK 
Developed  Design 


Design  3.8.243 
38  factorial  in  243  units 
1/27  replicate 

I  *  BCDEFG  «  ACDE2F2H  «  ABD2e2f 
NBS  #54,  p.  25 

Design  3.8.729 
38  factorial  In  729  units 
1/9  replicate 
I  =  ABCDEH2  *  CD2EF2G2 
NBS  #54,  p.  23 


Design  3.9.81 
39  factorial  in  81  units 
1/243  replicate 

I  =  BCDEFG  =  ACDE2F2H  =  ABD2e2fJ 
AB2C2DF  =  ABC2EF2 
NBS  #54,  p.  36 

Design  3.9.729 
3®  factorial  in  729  units 
1/27  replicate 

I  =  BCDEFG  =  ACDE2F2H  =  ABD2E2FJ 
NBS  #54,  p.  26 
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USER'S  APPENDIX  GUIDE  WITH  EXAMPLES 


INTRODUCTION 

This  appendix  describes  the  procedures  for  using  the  AED  computer  program,  the 
"conversational  mode"  of  the  program  operation  is  illustrated,  the  functions 
of  each  of  the  program  segments  are  explained,  and  a  listing  Is  included  of 
the  program  input  and  output  for  an  example  from  each  segment. 


SYSTEM  STRUCTURE 

The  automated  experimental  design  program  is  divided  into  five  program  segments. 
Upon  execution  of  the  program,  a  display  menu  Is  presented.  The  user  may  select 
one  of  the  five  by  inputting  the  number  of  the  segment  he  wishes.  The  program 
echoes  the  input  and  requests  the  user  to  input  an  identification  label  to  identify 
the  run.  The  I.D.  label  may  be  any  alphanumberic  string. 

The  menu,  entry  request,  and  I.D.  label  request  occur  whenever  a  segment  is 
completed  and  the  program  is  ready  to  enter  another  segment.  The  actual  test 
displayed  and  a  system  "walk-through"  will  be  included  with  the  explanation  of 
the  use  of  each  segment  in  the  following  sections. 

BASIC  TERMINOLOGY 

Segment  1— Basic  Terminology--provides  the  user  with  a  basic  introduction  to  the 
process  of  experimental  design.  A  description  of  the  program  assumptions,  vocabu¬ 
lary,  and  a  discussion  of  the  rationale  behind  experimental  designs  are  provided. 
This  material  Is  essentially  a  tutorial  for  the  user  who  is  unfamiliar  with  ex¬ 
perimental  design.  Once  the  user  is  acquainted  with  the  design  process,  there 
should  be  no  need  to  enter  this  segment  except  for  an  occasional  review  session. 
User  input  is  explained  in  this  segment. 


WELCOME  TO  THE  AUTOMATED  EXPERIMENTAL  DESIGN  PROGRAM 
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EVEN  ONE  AT  A  TIME  IN  ORDER  TO  FORMULATE  A  LAW  RELATING  RESPONSE  TO  THE 
LEVEL  FOR  EACH  FACTOR. 
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THE  LEVEL  OF  A  FACTOR  TRANSLATED  FROM  THE  TRUE  QUANTITATIVE 
LEVEL  USED  FOR  SIMPLIFYING  CALCULATIONS. 
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BASIC  TERMINOLOGY  TEST  RUN 


PROBLEM  DEFINITION 

Segment  2— Problem  Definition— is  used  by  the  experimenter  to  define  the  parti¬ 
cular  problem  being  studied.  A  new  menu  is  displayed  allowing  the  user  to 
select  one  of  four  options. 

BASIC  FACTORIAL  DESIGNS 

Option  1— Basic  Factorial  Designs— allows  the  user  to  define  full  or  frac¬ 
tional  factorial  designs  for  2,  3,  or  5  levels.  This  definition  includes: 

(1)  the  number  of  factors,  (2)  the  number  of  levels  per  each  factor,  (3)  the 
number  of  experimental  trials  available,  and  (4)  aliasing  information. 

Since  the  process  of  specifying  the  defining  contrasts  that  determine  the 
aliasing  is  critical,  the  user  is  offered  assistance  in  the  definition  of 
these  aliases.  In  this  help  section,  the  program  can  provide  certain  prede¬ 
fined  designs  (see  example  1).  These  designs  are  described  in  Volume  I  of 
this  report. 

If  the  predefined  alias  set  is  unacceptable  or  if  one  is  not  available,  the 
user  is  given  help  (for  2  level  designs  only)  in  developing  a  "good"  alias 
set  by  taking  the  predefined  design  and  either  by  deleting  factors  (see 
example  2)  or  by  adding  factors  (see  example  3)  arrives  at  a  new  option  design. 
If  the  user  is  still  not  satisfied  with  the  design,  the  defining  contrasts 
can  be  specified  as  input  values. 

Care  should  be  taken  that  the  members  of  the  alias  set  are  linearly  independent, 
since  if  any  member  of  the  alias  set  is  a  linear  combination  of  the  other 
members,  the  experimental  block  will  contain  more  than  the  desired  number  of 
observations.  The  program  will  check  for  Independence  of  the  alias  set,  and 
give  the  user  an  opportunity  to  redefine  the  set. 

The  user  may  also  have  the  total  alias  set  displayed.  (The  total  alias  set 
is  constructed  by  forming  all  possible  combinations  of  the  original  defining 
contrasts  specified  by  the  user.)  The  alias  set  may  be  redefined  until  the 
design  is  acceptable  to  the  user. 
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The  user  may  also  have  the  total  alias  set  displayed.  (The  total  alias  set 
is  constructed  by  forming  all  possible  combinations  of  the  original  defining 
contrasts  specified  by  the  user.)  The  alias  set  may  be  redefined  until  the 
design  is  acceptable  to  the  user. 
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FOR  A  2  LEVEL  PER  FACTOR  EXPERIMENT,  THE  ABSENCE  OF  A  LETTER  INDICATES 
THE  FACTOR  IS  AT  ITS  LOW  LEVEL. 

THE  PRESENCE  OF  A  LETTER  INDICATES  THE  FACTOR  IS  AT  ITS  HIGH  LEVEL. 
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THE  BEST  THEORETICAL  DESIGN  MAY  OR  MAY  NOT  BE  ACHIEVABLE. 


HIT  RETURN  WHEN  READY  TO  CONTINUE. 


WELCOME  TO  THE  AUTOMATED  EXPERIMENTAL  DESIGN  PROGRAM 
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HOW  MANY  LEVELS  FOR  THE  FACTORS:  (2,3,  or  5) 


THIS  IS  A  1/A  FRACTIONAL  FACTORIAL  DESIGN.  FOR  AH  EXPERIMENT  OF 
THIS  SIZE,  YOU  WILL  NEED  2  LINEARLY  INDEPENDENT  DEFINING  CONTRAST(s) . 
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DO  YOU  WANT  HELP  IN  GENERATING  A  REALIZABLE  2  LEVEL  ALIAS  SET? 
YES 
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DEFINING  CONTRAST  PRODUCT  ORIGINAL  DESIGN  ADDED  COLUMN  NUMBER  OF  FACTORS  PER  ROU 


PROBLEM  DEFINITION  COMPLETED. 


MIXED  LEVEL  DESIGNS 

Option  2— Mixed  Level  Designs  allow  the  user  to  define  full  or  fractional 
factorial  designs  where  some  factors  of  the  design  have  a  different  number  of 
levels  than  other  factors  of  the  design.  A  menu  Is  displayed,  but  at  this 
time  only  the  2  level  crossed  with  the  3  level  case  has  been  developed  (see 
the  following  example).  The  mixed  level  design  is  treated  like  two  separate 
designs,  one  for  the  factors  at  2  levels  and  one  for  the  factors  at  3  levels. 
Then  the  resulting  obeservation  blocks  from  the  two  separate  designs  are 
combined  to  produce  a  mixed  level  observation  block. 

The  displayed  menu  also  allows  the  user  to  exit  if  the  2x3  mixed  level  Is 
not  desired. 
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FOR  A  2  LEVEL  PER  FACTOR  EXPERIMENT,  THE  ABSENCE  OF  A  LETTER  INDICATES 
THE  FACTOR  IS  AT  ITS  LOW  LEVEL. 

THE  PRESENCE  OF  A  LETTER  INDICATES  THE  FACTOR  IS  AT  ITS  HIGH  LEVEL. 


ft 


co  to 

u 

OS  P 

8  o 
u  w 

<  os 

bu  O 

H 

-  co 

U 

>  s 

u  co 
J  •  3 
J  O 
SUM 

o  >  > 

M  U  U 

S  -1  PS 
o* 

M  I 
X  CJ  < 
M  M 

s  u 

H  CO 

-ejos 

<  M  O 

ISB 

8“5 

(».  os 


co  os  co 
HUS 
USB 
U  X  U 
U  O  X 
to.  Z 

u  <  z  a 
M  o 
S  ca 

o  •  o  ■< 

M  Q  Z 
S  U  M  I 
5  N  CO 
CD  <  M 
U  <  M 
Z  J  - 

M  <  u 

CD  -  J 
M  U  U  Oj 
DCUSZ 
U  B  H  < 
co  £  x 

u<utd 

Q  X  Z  _ 

U  H  B 

X  bu  O 
SO  OS  U  to. 

«2° 

£ 

<  •  O 

os  o  co  u 

H  U  H  to. 
Z  O  to. 
O  Z  X  u 
U  3  < 
o  *  X 

M  bu  X 
Z  Z  X 
M  O  Z  X 
to.  U  C  Z 
U  XU 

ouzo 

O  C  H 

X  u 

<  o  u 

Z  X  U  S 

ai  H 

sue 
O  as  *  to. 
X  <  o 


ee  u 

U  X 

H 

a 

H  Z 

CO  O 

as  u 

m  u 

bu  CO 


i  s 

X  X 

co  n 


< 

X 

O  X 

H  U 

co 
u 

s  to 

X  < 


p 

co  u 
co  us 
M  M  X  X 


2  u  z  i 

O  Q  <  I 
PS 

X  o  - 
co  Z  i 
PS  X  I 
H  CO  OS  I 
bu  os  U  I 
i-i  X  I 
Q  to-  X  I 
Z  U  l 
<00, 

CO  <  U  I 

rv  X  X 
Vi  CJ 

u  a  a  i 

Us  t j-  H  i 
U  U.  h  ; 

ui  2  i 

z 

»-i  z  o 

g  =  s 

os  <  u 
u  u  os 

CO  < 

*§  P  CO 
Z  w  X 
Jt  o 

u  u 

S  O  bu 
X  U  bu 
O  U 
bu  z 

°  5  z 

O  M 
X  bu  < 

Sj  O 

I0  * 

S  co  co 
co  z  z 

_  o  o 

<  M  M 

co  o  y 

M  eS  eS 

co  u  u 
m  X  X 
s  z  z 

H  H  M 


X  00 

CJ 

fid  fid 

>  J- 

00 

fid  H 

o 

X  fid 

H 

X 

u 

fid 

— » 

5  fid 

< 

fib 

os 

m3  s 

00  M 

H 

c 

O  00 

02 

z 

E-  CJ 

s  w 

< 

P 

CJ  CO 

P  i-3 

p 

P 

P 

<  fid 

M 

«k 

p 

* 

P 

fib  c 

C/3  S 

X 

p 

P 

P 

M  5 

fid 

P 

P 

P 

•  X  O 

> 

P 

* 

i-3 

P 

U  U  H 

OS  • 

fid 

P 

P 

.-3 

P 

H  < 

02 

X 

P 

* 

C/3 

M 

P 

fid  fid  C 

H  02 

P 

P 

< 

*P 

X 

H  > 

3 

P  09 

P 

M 

P 

•  X  CO 

03  03 

C 

*  < 

P 

i-3 

P 

C  CJ  3 

J  »-2 

fi-4 

H 

CJ 

x 

&  < 

X 

X 


H  CJ 

HI  X 

X  X 
x  x 
H 

°  - 
H  H 

X  H 

x  z  3 
x  < 
x  x  e 
eo  X 
O  x 
H  <  < 


C/3 

os 

■K 

3 

z 

CO 

«P 

3 

z  « 

bd 

— 

Z  -P 

j 

Z 

00 

Z 

0  "0 

3 

0  *p 

M 

w 

03 

X 

hi 

M  « 

O 

H 

M  -P 

3 

*•4 

M 

H 

E-  * 

*- 

• 

H  « 

C/3 

o 

z 

^  * 

Z 

3 

3 

03 

M 

© 

o 

x  « 

O 

O 

2  -p 

O 

a 

s 

CJ 

H  « 

s 

M 

H  ♦ 

>< 

co  * 

H 

bd 

C/3  * 

.J! 

o 

z  « 

z 

0. 

fid 

Z  « 

Z 

< 

H 

S  * 

0 

M 

co 

• 

Q  * 

CJ 

1— 

£  « 

M 

00 

1 

bd 

2  * 

— 

z 

>* 

fid  « 

H 

CJ 

O 

3 

3  * 

co 

03 

bl 

Q 

C  « 

CJ 

H 

Z 

0  * 

bd 

Mm 

-3 

< 

« 

< 

bd 

1 

M 

■p 

O 

eg 

bd 

Z  « 

X 

O 

as  1 

H 

z  « 

as 

00 

O  * 

fid 

<  ! 

Z 

0  * 

J 

03 

H 

H 

M  ■« 

H 

H 

1 

O 

M  -P 

bd 

so 

cn 

z 

CO  « 

Z 

CJ 

oe  1 

3 

C/3 

> 

i 

o 

>* 

bd 

fid  « 

M 

fid 

bd 

03  « 

bd 

03 

00 

3; 

O  « 

fib 

H  1 

O 

O  * 

•d 

< 

3 

* 

H 

fib 

Z  1 

P 

« 

X 

X  « 

O 

fid 

bd 

m3  « 

a 

9m 

Mm 

z 

tad  « 

bd 

Z 

03  -P 

w 

5 

5 

>  « 

C» 

fid 

i 

2 

>  « 

X 

CO 

3 

bd  « 

b- 

—3 

••  ! 

3 

03  « 

M 

H 

X  * 

fid 

P 

fid  1 

H 

—2  « 

X 

fau 

Bd 

* 

J  1 

bd 

« 

o 

00 

B  « 

* 

00 

0b  1 

X 

C  «P 

< 

z 

bd  « 

CJ 

fid 

Z 

02  « 

1-4 

e 

H 

X  * 

M 

?  1 

h 

X  * 

ec 

< 

o 

Z 

— 

1-1  * 

2 

X  1 

— < 

M  « 

O 

2 

x 

5 

X  « 

s 

fid 

bd 

3 

z  * 

£ 

O 

■p 

X 

Z 

• 

>4 

CJ 

HI 

X 

z 

<  X 

-p 

X 

CO 

HI 

c 

H 

** 

* 

X 

M 

X  < 

z 

* 

z 

E-> 

O  HI 

0 

• 

•p 

< 

• 

0 

HI 

Ct 

M 

•p 

H 

HI 

z 

X  X 

CO 

03 

■p 

CO 

O 

H 

HI 

CJ  X 

bd 

■p 

•<e 

X 

< 

X 

z  S 

a 

H 

■p 

X 

H 

X 

X  X 

CO 

p 

e 

X 

O 

0 

X  H 

< 

p 

X 

X 

Z 

X  Z 

bd 

X 

p 

E - 

X 

<  HI 

> 

H 

p 

<£ 

?" 

CJ 

< 

■ 

fid 

Z 

p 

Z 

E- 

z 

HI 

X  X 

.d 

c 

p 

CJ 

HI 

HI 

X 

s  z 

02 

CJ 

p 

M 

H 

5 

•< 

H  H 

> 

a 

p 

co 

z 

Q 

02 

bd 

CJ 

p 

X 

X 

J 

X 

-  X 

-3 

X 

z 

p 

B 

B 

X 

0 

H  X 

M 

M 

p 

HI 

0 

Z  H 

S 

X 

z 

p 

X 

X 

X 

X  < 

O 

M 

z 

p 

X 

X 

< 

Z  CJ 

bd 

X 

0 

p 

X 

HI 

—  HI 

jj 

3 

X 

l-l 

p 

E- 

P 

X 

X  c 

P 

B 

H 

p 

M 

H 

E- 

X  z 

03 

<£ 

p 

S 

X 

X  HI 

2S 

fib 

H 

X 

p 

X 

0 

X 

X 

X 

P 

O 

Z 

H 

p 

X 

E- 

•< 

X  X 

X 

CO 

p 

z 

Z 

X 

X 

03 

Z 

0 

z 

p 

0 

a 

3 

66  f- 

03 

O 

z 

*  0 

p 

t-l 

X 

s 

O 

0  r 

H 

M 

X 

x  x 

p 

X 

> 

M 

HI 

H  X 

< 

H 

X 

3  X 

p 

X 

x  < 

E- 

X  X 

CJ 

X 

X 

z  0 « 

B 

X 

X 

X 

< 

O  K  «  o 

S|S:S 

tiUUU 

p  5  i  p 


i  < 

*"*  fl£ 

PM  O 

<  s 

a-  x 


<  £  |  S 

x  w  3  cj 

£p£  5! 


-120- 


AT  ITS  INTERMEDIATE  LEVEL. 

WOULD  YOU  LIKE  TO  USE  A  PREVIOUSLY  STORED  DESIGN? 
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EXPERIMENTAL  DESICN  SUMMARY 

MAIN  1-ST  HIGHER  EFFECT 


HIT  RETURN  TO  CONTINUE 
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CENTRAL  COMPOSITE  DESI6NS 

Option  3— Central  Composite  Designs  allow  the  user  to  add  more  observation 
vectors  to  the  basic  factorial  experiments  In  order  that  a  quadratic 
approximation  to  the  response  surface  of  the  experimental  region  can  be  made. 
The  user  can  choose  a  rotatable  or  non-rotatable  central  composite  design. 

There  are  also  two  methods  for  specifying  the  real  world  levels.  One  Is  to 
specify  the  real  world  range  for  each  factor.  The  other  Is  to  specify  the 
real  world  levels  of  each  factor  In  the  basic  factorial  design. 

Central  composite  designs  can  be  defined  In  one  of  two  ways.  The  user  may 
use  program  segment  2  -  option  1  and  program  segment  3  to  define  the  basic 
factorial  portion  of  the  central  composite  design,  then  enter  segment  2  - 
option  3  to  complete  the  additional  experiments  (see  example  1). 

Or  the  user  may  enter  directly  Into  segment  2  -  option  3  In  which  case,  the 
program  will  prompt  the  user  for  the  basic  factorial  definition  (see  example  2). 

EXIT 

Option  4— Exit  allows  the  user  to  exit  from  the  problem  definition  segment. 


nOW  MANY  FACTORS  ARE  INVOLVED? 
YOU  HAY  CHOOSE  UP  TO  20. 


THIS  IS  A  FULL  FACTORIAL  DESIGN. 

FOR  AN  EXPERIMENT  OF  THIS  SIZE,  YOU  WILL  NEED 
0  LINEARLY  INDEPENDENT  DEFINING  CONTRAST (s). 
PROBLEM  DEFINITION  COMPLETED. 


CENTRAL  COMPOSITE  DEMONSTRATION 

************* ****************** 
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CENTRAL  COMPOSITE  DEMONSTRATION 


HIT  RETURN  TO  CONTINUE 


THIS  REQUIRES  THAT  THE  EXPERIMENTER  DESCRIBE  A  NEW  DESIGN. 

THE  MOST  EFFICIENT  WAY  TO  DESCRIBE  THE  NEW  DESIGN  IS  TO  USE  THE 
PROGRAM  DESIGN  DEFINITION  CAPABILITY  AS  IN  SEGMENTS  2  -  OPTION  1  and  3. 


NOW  UE  MUST  DEFINE  THE  SPECIFIC  PROBLEM  TO  BE  ANALYZED  IN  THIS  RUN 
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CENTRAL  COMPOSITE  DEMONSTRATION 

**************************************************** 
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WHICH  METHOD  WOULD  YOU  LIKE?  ENTER 
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ENTER  THE  UPPER  REAL  WORLD  RANGE  CORRESPONDING  TO  THE  CODED 

LEVEL  +ALPHA  FOR  FACTOR  NUMBER  3 

11.40 


r 


1 


M 

o  « 

o  sr  a 

vO  .  -1 

*  *-*  i 

>»  •*  > 


ao 

M3 

1*1  • 
cs  ao  *-* 

«  ii 

3  O  2 

WH  < 

SO  HI 

<  at 
J  U.  H 


ao  at  at 
O  O  O 

ddo 
^  a5  ^ 

(l*  bU  (la 


M  o  u  u 

(h  M  M  HI 

g  COJ2- 


lb  lb  k 

o  o  o 


•  •  Ob  H 

O  O  pi  M 

z  z  <  s 


-145- 


HIT  RETURN  TO  CONTINUE 
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ACTUAL  EXPERIMENTAL  DESIGN 

Segment  3— Actual  Experimental  Design-uses  the  previously  specified  experi¬ 
mental  definition  (Segment  2  -  Option  1)  to  construct  the  set  of  experimental 
treatments  to  be  run.  This  set  Is  called  the  basic  experimental  block/obser- 
vatlon  vectors.  To  aid  the  experimenter  In  deciding  If  the  experiment  has  an 
acceptable  structure,  an  alias  summary  Is  displayed  that  shows  how  main  effects 
and  first-order  Interactions  are  aliased.  The  user  may  also  have  the  aliasing 
of  any  specific  effect  displayed. 

If  the  design  Is  unacceptable,  the  experimenter  can  rerun  the  problem  defini¬ 
tion  phase. 

The  following  Is  an  example  of  the  experimental  design  of  the  problem  defined 
in  Segment  2  -  Option  1  -  Example  1. 
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MAIN  1-ST  HIGHER  EFFECT 
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DATA  ANALYSIS 

Once  the  data  have  been  collected.  It  must  be  analyzed  to  identify  significant 
effects.  This  analysis  could  consist  of  an  analysis  of  variance  (ANOVA)  or 
of  a  regression  analysis. 

The  capability  to  perform  the  data  analysis  has  not  been  included  in  the  AED 
program  at  this  time  since  a  program  to  analyze  a  fractional  factorial  experi¬ 
ment  with  both  regression  analysis  and  ANOVA  techniques  would  be  a  full-time 
project  in  itself.  The  program  user  should  analyze  his  data  with  existing 
routines  available  at  AMRL  or  other  computer  facilities. 

EXPERIMENTAL  REFINEMENT 

Once  the  experimenter  has  conducted  a  fraction  of  a  full  factorial  experiment, 
an  analysis  of  the  basic  block  data  may  provide  sufficient  Information  to 
preclude  additional  data  collection.  If  one  or  more  factors  produce  signifi¬ 
cant  results,  all  further  work  may  be  confined  to  studying  these  factors  in 
detail.  The  experiment  may  be  redesigned  with  fewer  factors  or  with  other 
factors  added.  Additional  work  is  required  if: 

1.  The  main  effects  are  not  given  with  sufficient  precision. 

2.  Some  main  effects  may  be  confounded  with  two-factor  interactions  and  may 
require  separation. 

3.  Some  two-factor  Interactions  may  require  separation. 

4.  Additional  factors  may  need  to  be  included  in  the  design. 

SEPARATION  OF  ALIASES 

Separation  of  aliases  assumes  that  a  fractional  design  has  been  executed  and 
that  we  wish  to  collect  additional  data  In  order  to  obtain  a  higher  degree  of 
precision  and/or  to  separate  the  main  effects  from  two-factor  interactions. 

A  1/2  factorial  or  a  1/3  factorial  will  require  a  full  factorial  to  separate 
aliases,  thus,  this  assumes  that  a  1/4  or  1/9  (etc.)  fractional  factorial 


has  been  performed  and  the  problem  Is  to  separate  effect  X  from  effect  Y, 
i.e.,  X  and  Y  are  In  the  same  aliasing  group,  X=Y. 


The  user  will  define  the  aliased  terms  and  the  program  will  tell  the  user 
which  of  his  original  alias  terms  may  be  deleted  to  remove  this  aliasing. 

The  following  is  an  example  of  the  separation  of  alias  feature. 

The  problem  can  be  defined  in  one  of  two  ways.  The  user  may  use  program 
segments  2  -  options  1  and  3  to  define  the  problem,  then  enter  segment  4  to 
perform  the  refinement  (see  example  1). 

Or  the  user  may  enter  directly  into  segment  4  in  which  case,  the  program  will 
prompt  him  for  the  program  definition  (see  example  2). 
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WELCOME  TO  THE  AUTOMATED  EXPERIMENTAL  DESIGN  PROGRAM. 


THE  DEFINING  CONTRAST  SET  DEFINED  CONTAINS  2  INDEPENDENT  MEMBER(s). 


BASIC  FACTORIAL  DESIGNS 
MIXED  LEVEL  DESIGNS 
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WHICH  EFFECT/ INTERACTION  DO  YOU  WANT  TO  SEE? 

ENTER  THE  EFFECT  DESCRIPTION.  ENTER  A  BLANK  TO  EXIT. 
EXAMPLE:  ENTER  AB  TO  SEE  WHAT  IS  ALIASED  WITH  EFFECT  AB. 


BASIC  EXPERIMENTAL  BLOCK/ OBSERVATION  VECTOR 
THESE  ARE  THE  EXPERIMENTAL  OBSERVATIONS  TO  BE  RUN 
IN  THE  DATA  COLLECTION  PROCESS. 

FOR  A  2  LEVEL  PER  FACTOR  EXPERIMENT,  0  AND  1  REPRESENT 
THE  LOW  AND  HIGH  FACTOR  VALUES.  FOR  A  3  LEVEL  PER  FACTOR 


HIT  RETURN  WHEN  READY  TO  CONTINUE. 
EXPERIMENTAL  REFINEMENT  DEMONSTRATION 
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HOW  MANY  LEVELS  FOR  THE  FACTORS?  (2,3,  or  5) 


THE  FACTORS  IN  THE  DESIGN  MUST  BE  DESIGNATED  AS  A.B.C.D,  ETC 
THE  LETTER  I  IS  RESERVED  FOR  THE  IDENTITY  EFFECT. 
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DO  YOU  WANT  TO  SEE  THE  TOTAL  ALIAS  SET? 
YES 
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V 


BASIC  EXPERIMENTAL  BLOCK/ OBSERVATION  VECTOR 
THESE  ARE  THE  EXPERIMENTAL  OBSERVATIONS  TO  BE  RUN 
IN  THE  DATA  COLLECTION  PROCESS. 

FOR  THIS  2  LEVEL  PER  FACTOR  EXPERIMENT,  0  AND  1  REPRESENT 
THE  LOU  AND  HIGH  FACTOR  VALUES. 


HIT  RETURN  WIEN  READY  TO  CONTINUE 
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EXPERIMENTAL  DESIGN  SUMMARY 
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HIT  RETURN  WHEN  READY  TO  CONTINUE. 


EXIT 

Segment  5— Exit  Is  the  segment  to  enter  from  the  AED  program. 
The  following  Is  an  example  of  its  use. 
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EXPERIMENTAL  DESIGN  PROGRAM. 
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